Computer  Science  Department 


^^SM  TECHNICAL  REPORT 


'..fj 


H 


w 


^f 


'mDi 


m^ 


L' 


m 


■i>-  *" 


^'i 


fyi' 


;^y 


,^^ 


y^ 


y^x 


Semantic  Analyses  for  Storage  Management 
Optimizations  in  Functional 
Language  Implementations 


Young  Gil  Park 


Technical  Report  597 

February  1992 


NEW  YORK  UNIVERSITY 


in 

I     >H 

EH  O 

u  c 

CO    D 
P^    O 

o 

no   s-i 

:  a< 


o 

c 

CO  <D 

0)  E 

>,  en  col 

(0  c  o  I 

C  (0   -rH 

0  CU    N 

4-1  fd  e 

C  !-J 

(0  o  -P 

E  -P  DjI 

01  CO    o 
CO 


ix.. 


'.S^    Department  of  Computer  Science 
Courant  Institute  of  Mathematical  Sciences 

251  MERCER  STREET,  NEW  YORK,  N.Y.  10012 


Semantic  Analyses  for  Storage  Management 
Optimizations  in  Functional 
Language  Implementations 


Young  Gil  Park 


Technical  Report  597 

February  1992 


Semantic  Analyses  for  Storage  Management  Optimizations 
in  Functional  Language  Implementations 


by 


Young  Gil  Park 


A  dissertation  submitted  in  partial  fulfillment 

of  the  requirements  for  the  degree  of 

Doctor  of  Philosophy 

Department  of  Computer  Science 

New  York  University 

September  1991 


Approved  : 

Benjamin  Goldberg 
Research  Advisor 


©Young  Gil  Park 
All  Rights  Reserved.  1991 


To 

Grace  Sunjung  and  Jihwa  Park 


Acknowledgements 


First,  I  would  like  to  express  my  sincere  thanks  to  my  advisor,  Professor  Benjamin 
Goldberg,  for  all  his  guidance,  suggestions,  advice  and  the  many  other  things  throughout 
the  years.  I  wroiild  also  hke  to  thank  Professors  Robert  Paige  and  Edmond  Schonberg  for 
reading  a  draft  of  this  thesis  and  giving  valuable  comments  as  well  as  serving  on  my  thesis 
committee.  I  wish  to  thank  all  the  other  members  of  my  committee.  Professors  Robert 
Dewar  and  Malcolm  Harrison,  for  their  helpful  comments  and  encoiiragements. 

For  their  advice  and  help,  I  am  grateful  to  all  the  people  in  Programming  Languages 
Lab  at  Courant  Listitute,  Professors  Paul  Hudak  at  Yale  University,  Arvind  at  MIT,  Peter 
Lee  at  Carnegie- Mellon  University  and  Dr.  Henry  Baker  at  Nimble  Computer  Corporation. 

Last,  by  no  means  least,  I  would  hke  to  thardc  my  wife  Jihwa  and  my  daughter  Grace 
Sunjiing  -  I  owe  everything  to  you!  I  would  also  like  to  thank  my  parent  for  their  constant 
love  and  support. 

This  research  was  supported  in  part  by  Korea  Goverimient  Graduate  Fellowship,  Na- 
tional Science  Foundation  (#CCR-8909634)  and  DARPA/ONR  (#N00014-90-1110). 


Abstract 


Semantic  Analyses  for  Storage  Management  Optimizations 
in  Functional  Language  Implementations 

Young  Gil  Park 

Ph.D.,  Department  of  Computer  Science,  New  York  University,  September  1991. 

(Research  advisor:  Benjamin  Goldberg) 


One  of  the  major  overheads  in  implementing  functional  languages  is  the  storage  manage- 
ment overhead  due  to  dynamic  cdlocation  and  automatic  reclamation  of  indefinite-extent 
storage.  This  dissertation  investigates  the  problems  of  statically  inferring  lifetime  informa- 
tion about  dynamically-allocated  objects  in  higher-order  polymorphic  functioned  languages, 
both  strict  and  non-strict,  and  of  applying  that  information  to  reduce  the  storage  manage- 
ment overhead. 

We  have  developed  a  set  of  compile-time  semantic  analyses  for  a  higher-order,  monomor- 
phic,  strict  functional  language  based  on  denotational  semantics  cind  abstract  interpreta- 
tion. They  are  1)  escape  analysis,  which  provides  information  about  the  relative  lifetimes 
of  objects  such  as  arguments  and  local  objects  defined  within  a  function  with  respect  to  an 
activation  of  the  function  call,  2)  refined  escape  analysts  which,  as  a  refinement  of  escape 
analysis,  provides  information  about  the  hfetimes  of  components  of  aggregate  structures, 
and  3)  reference  escape  analysis  which  provides  information  about  the  relative  lifetimes  of 
references  created  within  a  function  with  respect  to  an  activation  of  the  function. 

We  cdso  have  developed  a  compile-time  semantic  analysis  called  order- of- demand  anal- 
ysis for  higher-order,  monomorphic,  non-strict  functional  languages,  which  provides  infor- 
mation about  the  order  in  which  the  values  of  bound  variables  are  demanded  and  thus 
allows  one  to  compute  a  range  of  information  including  strictness,  evaluation-order,  and 
evaluation-status  information. 

Using  the  notion  of  polymorphic  invariance,  we  describe  a  method  for  analyzing  a  poly- 
morphic language  by  using  the  analyses  for  a  monomorphic  language.  We  then  extend  those 
analyses  for  a  strict  language  to  a  non-strict  language  using  non-strict  program  trzmsfor- 
mation  and  evaluation-status  information. 
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Based  on  statically  inferred  escape  information,  we  propose  a  combination  of  storage 
igement  optimization  techniques  including  stack  allocation,  explicit  reclamation,  in- 
place  reuse,  reference  counting  elimination,  block  allocation/reclamation,  and  improving 
generational  garbage  collection. 
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Chapter  1 


Introduction 


Functional  programming  languages  provide  a  variety  of  useful  featiues  such  as  referential 
transparency,  higher-order  functions,  non-strict  semantics  cind  implicit  storage  manage- 
ment. Fimctional  languages,  how^ever,  have  gained  popularity  much  slower  than  imperative 
ones  because  their  implementations  on  conventional  sequential  and  parallel  computers  have 
tended  to  show  relatively  poor  performance.  Optimization  to  improve  the  performance  of 
functional  languages  is  thus  an  essential  component  in  any  viable  implementation.  One  of 
the  major  overheads  incurred  by  functional  language  implementations  is  the  storage  man- 
agement overhead  due  to  dynamic  allocation  and  automatic  reclamation  of  indefinite-extent 
storage.  This  thesis  explores  the  optimization  problem  of  reducing  the  storage  manage- 
ment overhead  by  obtaining  lifetime  information  about  dynamically-allocated  objects  in 
higher-order  polymorphic  functional  languages,  which  is  inferred  at  compile-time  through 
semantics-based  analyses  of  high-level  source  programs. 

1.1      Functional  Languages 

The  class  of  modern  functional  programming  languages  exhibits  several  useful  features  as 
follows  ([7],  [31],  [40],  [66]): 

•  Referential  TranspaTency  (Equational  Reasoning)  :  In  pure  functional  prograniming, 
a  program  has  no  modifiable  state,  because  of  the  lack  of  an  assignment  operator,  and 
thus  is  made  up  entirely  of  expressions.  The  evaluation  of  an  expression  is  guaranteed 
to  have  no  other  effects  on  the  program,  that  is,  no  side-effects.  The  absence  of  side- 
effects  guarantees  the  mathematical  property  of  refcTential  transparency  which  means 
that  any  syntactically  identical  pair  of  expressions  are  semantically  the  same,  scope 


rules  allowing,  and  this  makes  functional  prograims  easier  to  reason  about.  Programs 
can  be  treated  as  a  system  of  equations  and  equational  reasoning  can  be  applied. 
Functional  languages  ailso  have  a  completeness  property  which  states  that  the  reduction 
of  an  expression  using  a  general  normal-order  strategy  is  guaranteed  to  yield  a  result 
if  a  result  is  mathematically  deducible. 

•  Higher-Order  Functions  :  The  notion  of  a  function  is  the  primary  abstraction  mecha- 
nism in  any  progrcimming  Icinguage  and  thus  facilitating  the  use  of  functions  increases 
the  utility  of  that  kind  of  abstraction.  Much  of  the  power  of  a  programming  lan- 
guage can  come  from  the  advanced  use  of  functions.  Imperative  languages  such  as 
Algol68,  Pascal  and  C  allow  procedures  or  functions  to  be  passed  as  parameters  to 
other  procedures  and  functions,  but  does  not  permit  fimction-valued  or  procedure- 
valued  functions.  In  functionad  languages,  functions  are  treated  as  first-class  objects 
like  any  other  data  object  in  the  language.  Functions  that  are  allowed  to  be  put  in 
data  structures,  passed  as  an  argimient  in  function  calls,  £ind  returned  as  values  from 
expressions  including  function  calls  are  called  first-class  functions.  Those  languages 
supporting  higher-order  functions  generally  allow  functions  to  be  curried  or  partially 
applicable.  If  a  function  is  defined  to  take  several  argimients,  it  can  be  considered  as 
a  function  that  takes  only  one  argimient  and  returns  a  curried  function. 

•  Non-strict  Semantics  :  The  reduction  of  a  fimction  application  in  a  language  can 
generally  be  performed  in  two  ways:  strict  (applicative-order)  evaluation  order  cind 
non-strict  (normcd-order)  evaluation.  In  strict  semantics,  the  application  of  a  function 
to  its  arguments  results  in  the  argvunents  being  evaluated  before  they  are  passed  to 
the  fvmction  and  before  the  body  of  the  function  begins  execution.  This  corresponds 
to  applicative- order  reduction  in  the  lambda  calculus.  The  advantage  of  this  scheme, 
known  as  call-by-value,  is  that  it  is  easy  to  implement  efficiently;  first  we  evaluate  the 
argimients,  then  we  call  the  function.  However,  it  may  result  in  imnecessary  evaluation 
if  an  argimient's  value  is  not  ultimately  required  by  the  called  function.  In  non- 
strict  semantics,  an  argument  is  not  evaluated  unless  and  imtil  its  value  is  demanded 
inside  the  body  of  the  called  fimction;  all  arguments  are  passed  to  the  fimction  in 
an  unevaluated  form  and  are  only  evaluated  when  needed  inside  the  fimction  body. 
This  corresponds  to  normal-order  reduction  in  the  lambda  calculus.  The  advantage 
of  this  evaluation  method,  also  known  as  call-by-name,  is  that  no  effort  will  have 
been  wasted  if  the  argument  value  is  not  ultimately  required.  A  non-strict  semantics 
also  has  the  advantage  of  resulting  in  program  termination  more  often  than  a  strict 


semantics  since  the  evaluation  of  a  non- terminating  expression  may  be  avoided.  If  a 
program  terminates  using  both  call-by-value  and  call-by  name,  then  the  same  result 
will  be  returned  in  both  cases,  which  is  guaranteed  by  the  Church-Rosser  Property. 
Thus,  the  non-strict  language  avoids  redundant  evaluations  and  is  more  expressive 
than  the  strict  language.  That  is,  it  increases  the  power  of  functional  abstraction  and 
allows  the  definition  of  infinite  structures. 

•  Implicit  Storage  Management  :  Another  major  feature  of  functional  languages  is  that 
there  is  no  notion  of  explicit  storage  management.  The  programmer  is  relieved  from 
having  to  think  about  how  or  where  the  data  objects  in  a  program  are  stored  within 
the  computer  memory  and  from  writing  code  to  recover  inaccessible  memory  and 
reuse  it.  This  is  an  important  abstraction  from  the  housekeeping  needed  with  com- 
mon imperative  languages.  Data  types  can  be  defined  at  an  abstract  level  with  no 
concern  as  to  how  they  are  represented  internally,  this  being  handled  automatically 
by  implementation.  Furthermore,  the  lifetime  of  the  object  is  also  unimportant  as 
far  as  the  programmer  is  concerned  and  so  we  do  not  have  to  worry  about  when 
an  object  ceases  to  be  required  by  the  program.  Built-in  operations  on  data  auto- 
matically allocate  storage  as  needed  and  storage  that  becomes  inaccessible  is  then 
implicitly  deallocated  by  triggering  garbage  collection.  The  absence  of  explicit  code 
for  managing  storage  effectively  for  data  objects  makes  programs  simpler  and  shorter. 

•  Static  (Implicit)  Polymorphic  Typing  :  A  type  system  for  a  language  is  a  set  of  rules 
for  associating  a  type  with  expressions  in  the  language  to  avoid  embarrassing  questions 
about  representations,  and  to  forbid  situations  in  which  these  questions  might  come 
up.  Most  modern  functional  languages  adopt  a  rich  static  strong  polymorphic  type 
system  ([19],  [27],  [60],  [69])  in  which  polymorphism  is  allowed  in  both  primitive  and 
user-defined  functions,  and  a  type  inference  system  can  be  used  to  infer  the  types 
of  expressions  when  little  or  no  type  information  is  given  explicitly.  Static  strong 
typing,  which  means  that  expressions  are  type  consistent  and  thus  type  errors  can  not 
occur  at  run-time,  and  that  the  type  of  every  expression  can  be  determined  by  static 
program  analysis  rather  than  during  program  execution,  helps  in  debugging  since 
one  is  guaranteed  that  if  a  progrcim  compiles  successfully  then  no  error  can  occur 
at  run-time  due  to  type  violations.  It  also  leads  to  more  efficient  implementations, 
since  it  allows  one  to  eliminate  most  run-time  tags  and  type  testing,  but  it  may  lead 
to  a  loss  of  flexibility  and  expressive  power.  While  a  monomorphic  type  system  in 
which  every  value  can  be  interpreted  to  be  of  one  and  only  one  type  is  too  restrictive 


in  its  expressive  power,  a  function  that  is  assigned  a  type  expression  with  one  or 
several  type  variables  is  said  to  be  polymorphic,  which  means  that  it  can  have  several 
different  types.  Overloading  can  likewise  assume  different  types.  However,  it  is  just 
the  use  of  one  function  symbol  for  many  different  but  usually  related  functions.  For 
an  overloaded  function,  a  definition  must  be  given  for  each  possible  argument  type 
while  a  polymorphic  function  is  defined  in  a  single  definition.  Polymorphic  functions 
are  extremely  useful.  In  one  function  definition,  we  define  a  number  of  functions  that 
are  computationally  similar.  Without  polymorphism  we  have  to  give  one  definition  for 
each  case.  Polymorphism  makes  programming  simpler  since  we  can  define  functions 
that  are  useful  in  a  variety  of  applications.  Polymorphism  is  not  confined  to  functional 
languages,  but  it  reflect  the  importcince  of  higher-order  functions  to  the  expressive 
power  of  functional  languages.  It  is  generally  desirable  for  a  language  to  be  statically 
checked  using  a  powerful  and  strong  type  system. 

1.2   Storage  Management  Overhead 

A  high  implementation  overhead  is  required  to  support  a  variety  of  features  that  are  provided 
by  a  fimctional  language.  Despite  a  number  of  approaches  to  implementing  functional 
languages,  aU  implementations  deal  with  the  same  basic  underlying  issues,  i.e.  dynamic 
allocation  of  heap  objects  and  garbage-coUected  reclamation  of  them.  The  overhead  due  to 
storage  management  is  one  of  the  major  overheads  of  functional  language  implementations. 
The  principal  sources  of  the  storage  management  overhead  are  dynamic  allocation  and 
automatic  reclamation  of  indefinite  extent  storage. 

Dynamic  Heap  Allocation 

Heap  is  a  storage  which  is  allocated  and  reclaimed  dynamically  in  any  order  at  any  time 
during  a  program's  execution.  There  are  two  kinds  of  run-time  objects  to  be  dynamically 
allocated  in  indefinite-extent  heap  storage  during  the  execution  of  a  functional  program 

([31]): 

•  Objects  built  explicitly  by  the  program  such  as  records,  lists  and  trees  whose  size  can 
vary  during  the  running  of  a  program  and  thus  cannot  be  statically  determined. 

•  Objects  built  by  the  implementation  such  as  closures  for  representing  function  values 
and  delayed  expressions. 


In  the  implementation  of  a  language  with  imphcit  storage  management,  data  structures 
which  are  defined  explicitly  in  a  program  but  whose  size  cannot  be  statically  determined, 
such  as  lists,  trees,  records  and  so  on,  are  generally  allocated  in  the  heap.  Heap  is  also  needed 
to  support  higher-order  functions  ajid  non-strict /lazy  semantics  of  fimctional  languages. 
The  need  for  heap  allocation  airises  when  paraimeters  and  locally  defined  objects  within  a 
function  outlive  a  call  to  that  function.  In  programming  languages  which  do  not  support 
higher-order  functions,  lifetime  of  storage  for  local  variables  are  confined  to  a  function's 
activation  record.  Thus,  storage  for  the  locals  is  allocated  when  activation  begins  and  is 
deallocated  when  the  activation  ends. 

A  closure  is  a  means  of  representing  function  values,  which  consists  of  code  together 
with  its  free  variables.  The  use  of  closures  guarantees  that  variables  are  statically  scoped. 
In  languages  with  higher-order  functions  and  lexical  scoping  rules,  it  is  possible  to  write 
a  function,  say  /,  which  returns  a  lexically  enclosed  function,  say  g.  Allocating  the  envi- 
rormient  for  the  fimction  value  on  the  heap,  however,  adds  a  large  cost  to  each  function 
call. 

To  implement  non-strict  semantics  and  lazy  evaluation,  any  implementation  strategy 
uses  a  notion  of  delayed  expression  in  some  way,  but  in  the  abstract  they  all  do  the  same 
thing:  delay  the  evaluation  of  an  expression  until  its  value  is  demanded,  then  evaluate  it 
whenever  needed  (in  normal-order  implementation),  and  save  the  value  so  that  it  may  be 
used  on  future  demands  without  recomputation  (in  lazy  implementation).  Delayed  repre- 
sentation of  an  expression  must  contain  enough  information  to  enable  the  expression  to  be 
evaluated  later.  Moreover,  in  order  to  implement  lazy  evaluation  in  which  the  expression 
is  guaranteed  to  be  evaluated  at  most  once,  there  must  additionally  be  some  mechanism 
to  cache  the  value  of  the  expression  and  return  it  later  rather  re-evaluating  it.  Creating  a 
delayed  expression  requires  the  allocation  of  some  storage.  Because  the  value  of  the  delayed 
expression  might  be  needed  at  some  unlcnown  time  in  future,  it  must  be  allocated  in  a  heap 
which  has  an  indefinite  extent. 

Automatic  Storage  Reclamation 

An  implementation  of  a  programming  language  with  dynamic  heap  allocation  requires  some 
kind  of  storage  reclamation  mechanism,  either  explicit  or  implicit(automatic),  because  the 
heap  storage  occupied  by  objects  which  are  inaccessible  and  are  no  longer  required  in  the 
execution  of  the  program  have  to  be  automatically  reclaimed  so  that  the  physically  finite 
storage  is  not  rapidly  exhausted  by  the  program.   Automatic  storage  reclamation  is  espe- 


cially  important  in  implementations  of  declarative  languages,  such  as  functional  languages, 
that  have  no  notion  of  explicit  storage  control  and  tend  to  use  storage  extensively.  There 
are  three  basic  approaches,  with  a  number  of  Vciricints,  to  automatically  reuse  the  portions 
of  heap  storage,  called  garbage,  that  have  previously  been  allocated  but  are  no  longer  used 
by  the  program:  ([24],  [70])  reference  counting,  mark- and- sweep  garbage  collection,  and 
copying  garbage  collection. 

On  most  current  computer  systems,  heap  allocation  cind  automatic  storage  reclamation 
is  relatively  expensive.  A  significant  amount  of  overhead  both  in  time  and  in  space,  are 
incurred  in  the  process  of  automatic  storage  reclamation.  A  substantial  portion  of  the 
execution  time  is  spent  in  automatic  storage  reclamation.  Due  to  this  storage  management 
overhead,  in  conventional  computer  architectures,  typical  implementations  of  functional 
programs  aire  inefficient  and  waste  memory,  and  thus  functional  programs  tend  to  be  much 
slower  than  their  imperative  eqmvalents. 

1.3      The  Role  of  Lifetime  Information 

Like  many  other  programming  language  implementations,  efficient  storage  management  is 
a  central  concern  in  functional  language  implementations.  The  approaches  to  reduce  the 
storage  management  overhead  due  to  dynamic  heap  allocation  and  garbage  collection  in 
functional  language  implementations  can  generally  be  classified  into  three  ways  as  follows: 

1.  Avoid  heap  allocation  and  garbage  collection  by  using  a  storage  structure  (for  example, 
a  stack)  whose  allocation  and  reclamation  is  more  efficient  than  for  a  heap.  A  heap 
provides  a  very  general  storage  allocation  mechanism,  but  it  is  also  very  expensive.  In 
contrast,  a  stack  is  much  less  flexible  allocation  mechanism,  but  the  store  it  allocates 
is  recovered  immediately  when  it  becomes  unused,  and  this  recovery  simply  involves 
decrementing  the  stack  pointer. 

2.  Even  though  heap  allocation  and  garbage  collection  is  used,  reduce  the  frequency 
of  invoking  the  garbage  collection  by  reducing  the  frequency  of  running  out  of  free 
storage. 

•  3.  Even  though  the  garbage  collection  is  invoked,  improve  the  garbage  collection  scheme 
itself  rather  than  fully  relying  on  the  original  garbage  collection  scheme. 

We  describe  a  variety  of  storage  management  optimization  techniques  as  follows: 


•  Stack  Allocation  :  Objects  that  would  otherwise  be  allocated  in  the  heap  and  then 
reclaimed  using  garbage  collection  are  allocated  in  the  stack  and  cheaply  reclaimed 
without  invoking  garbage  collection.  ([16],  [20],  [34],  [42],  [55],  [76]) 

•  Explicit  Reclamation  and  In-place  Reuse  :  When  heap-allocated  objects  are  no  longer 
needed,  they  can  be  reclaimed  into  a  free  storage  hst  explicitly  by  the  program  without 
invoking  a  garbage  collection  process.  When  heap-cillocated  objects  are  no  longer 
needed,  their  storage  can  be  reused  directly  in  the  allocation  of  new  objects  without 
invoking  garbage  collection.  ([11],  [35],  [41],  [49],  [50],  [51]) 

•  Reference  Counting  Elimination  :  In  reference  coiuiting,  each  object  contains  a  coiuit, 
called  the  reference  coimt,  of  the  nvunber  of  references  (pointers)  pointing  to  it.  Each 
time  a  reference  is  created  or  destroyed  its  reference  count  needs  to  be  incremented 
or  decremented.  It  is  desirable  for  imjiecessary  updatings  on  reference  counts  at  each 
reference's  creation/  deletion  to  be  avoided.  ([9],  [32]) 

•  Block  Allocation/Reclamation  :  A  number  of  objects  are  allocated  together  in  a  con- 
tiguous block  of  a  heap  storage  and  the  whole  block  is  put  on  the  free  hst,  rather 
than  the  individual  objects.  This  allows  reclamation  of  larger  segments  of  storage, 
and  reduces  run-time  overhead  by  avoiding  the  traversal  of  the  individual  objects  (in 
mark-sweep  collection,  for  instance).  ([76]) 

The  main  reason  that  objects  are  allocated  on  a  heap  is  that  their  hfetime  is  gener- 
ally unknown  at  compile-time  and  thus  is  assumed  to  have  indefinite  extent.  In  principle, 
garbage  collection  can  be  avoided  by  compile-time  scheduling  of  storage  use.  Information 
about  the  hfetimes  of  objects  can  have  an  important  role  in  storage  management  optimiza- 
tions. Objects  allocated  on  the  heap  could  be  allocated  and  reclaimed  more  efficiently  if 
compilers  sought  to  extract  information  about  their  lifetimes  from  the  program  text  instead 
of  making  worst-case  assimiptions.  Stack  allocation  can  be  safely  applied  when  the  lifetimes 
of  objects  are  contained  in  the  lifetime  of  a  storage  which  can  be  reclaimed  in  the  reverse 
order  of  that  in  which  it  is  allocated.  Explicit  reclamation  and  in-place  reuse  can  be  applied 
when  the  lifetimes  of  heap-allocated  objects  are  known.  Reference  counting  elimination  can 
be  apphed  when  the  lifetimes  of  references  to  a  heap-allocated  object  are  known.  Block 
allocation/reclamation  can  be  applied  when  a  set  of  objects  whose  lifetimes  are  same  are 
to  be  allocated  on  a  heap. 


1.4      Lazy  Evaluation   Overhead  and  the  Role  of  Order-of- 
Demand  Information 

Many  modern  functional  languages  adopt  a  non-strict  semcintics  and  use  the  lazy  evaluation 
model.  In  a  non-strict  functional  language,  arguments  in  a  function  application  are  not 
evaluated  unless  and  until  their  values  are  demcinded.  An  optimized  version  of  normal- 
order  evaluation  is  lazy  evaluation  in  which  each  argument  is  evaluated  only  when  its  value 
is  first  demanded,  and  the  value  is  saved  for  later  demands.  The  implementation  of  lazy 
evaluation,  however,  involves  substantial  overhead  due  to 

1.  The  need  for  delaying  the  evaluation  of  arguments. 

2.  The  need  for  checking  their  evaluation  status  (that  is,  whether  they  have  already  been 
evaluated)  every  time  their  values  are  demanded. 

In  a  non-strict  functional  language  that  is  implemented  using  lazy  evaluation,  exact 
information  about  which  argimients  to  a  function  will  be  demanded,  what  the  order  of 
evaluation  among  the  argimients  of  a  function  is,  and  what  the  evaluation  status  of  an 
argument  is  when  its  value  is  demanded,  cannot  generally  be  decided  at  compile-time. 
If  such  information  could  be  safely  approximated  at  compile-time,  however,  a  number  of 
important  optimizations  could  be  performed.  Devising  such  analyses  and  optimizations  has 
been  a  major  focus  of  functional  language  reseairch  over  the  past  decade. 

Information  about  which  arguments  to  a  fimction  will  definitely  be  demanded,  called 
strictness  information,  is  used  to  optimize  lazy  evaluation  by  converting  lazy  evaluation 
into  applicative-order  evaluation  and  thus  reducing  the  overhead  of  lazy  evaluation  ([36], 
[31],  [63],  [66]).  Information  about  the  order  of  evaluation  of  the  arguments  to  a  function 
can  be  useful  for  a  number  of  optimizations,  including  copy  elimination  ([ll],  [30],  [35]) 
and  process  scheduling  in  a  parallel  system  [13].  Information  on  the  status  of  evaluation  of 
arguments  when  they  are  demanded  is  useful  for  eliminating  urmecessary  checking  [14]  and 
for  efficient  storage  management  of  delayed  expressions  (closures). 

These  information  can  be  reformulated  in  terms  of  information  about  the  order  in  which 
the  values  of  bound  variables  are  demanded,  called  order- of- demand  information,  as  foUows: 

•  Status  of  Evaluation:  Given  an  occurrence  Xi  of  a  variable  x  in  the  body  of  a  function 
/,  if  for  each  possible  execution  of  the  body  of  /  there  exists  another  occurrence  Xj  of 
X  such  that  Xj  is  demanded  before  a;,,  then  we  know  that  x  must  have  been  evaluated 


by  the  time  z,  is  encountered.  Thus  no  rxin-time  test  of  I's  status  is  required  to  obtain 
the  value  of  x^. 

•  Order  of  Evaluation:  Given  two  parameters  x  and  y  of  a  function  /,  if  for  every 
occurrence  t/i  of  y  in  the  body  of  /  there  exists  an  occurrence  Xj  of  x  that  is  demanded 
before  y,-,  then  we  can  conclude  that  x  will  always  be  evaluated  before  y. 

•  Strictness:  Given  a  parcimeter  a;  of  a  function  /,  if  we  can  determine  that  for  each  pos- 
sible (terminating)  execution  of  the  body  of  /  some  occurrence  x,  of  x  was  demanded, 
then  we  can  determine  that  /  is  strict  with  respect  to  x 

1.5      Semantics-based  Analysis 

Compiler  optimizations  should  not  affect  the  standard  semantics  of  programs,  but  may  af- 
fect the  pragmatics  of  programs.  Any  compile-time  program  analysis  for  optimization  is 
required  to  be  semantically  correct  or  safe  with  respect  to  the  standard  semantics.  For 
functional  programming  languages  that  have  precise,  straightforward  semantics,  denota- 
ttonal  semantics  ([4],  [74],  [79])  and  abstract  interpretation  ([2],  [17],  [25],  [26],  [46],  [44], 
[63])  are  particularly  powerful  tools  for  general  and  effective  program  analyses  to  infer 
certain  properties  of  programs  that  may  be  needed  for  semantics-preserving  optimizations. 

Denotational  Semantics 

To  perform  meaning-preserving  optimizations,  a  precise  semantics  is  needed  for  any  pro- 
gramming language.  Because  of  their  sound  theoretical  foundation,  functional  languages  are 
particularly  well  suited  for  semantics- based  analysis  of  programs.  Denotational  semantics  is 
a  formal  way  of  describing  the  (standard  or  non-standard)  meaning  of  a  program  in  terms 
of  mathematical  semantic  domains  that  properly  capture  our  intuition  about  program  be- 
haviors and  semantic  functions,  and  is  the  most  widely  used  tool  for  describing  the  formal 
semantics  of  fimctional  programming  languages. 

Domain  theory  and  denotational  semantics  were  introduced  to  give  meaning  to  syntac- 
tic expressions.  Formally,  we  consider  the  meaning  of  an  expression  to  be  a  value  taken 
from  some  domain  with  well  understood  mathematical  properties.  To  properly  represent 
the  results  of  all  computations,  a  suitable  domain  must  include  elements  representing  in- 
completely evaluated  objects,  and  thus  represent  approximations  to  completely  evaluated 
objects.  Therefore,  we  need  an  ordering  establishing  a  partial  order  based  on  the  definedness 
of  elements  and  a  least  element  on  the  domain  D  representing  the  completely  undefined 


object  (e.g.  non- termination).  We  also  require  that  domains  include  the  limits  of  iniinite 
chains  of  approximating  partial  elements,  i.e.  for  each  increasing  sequence  in  D,  the  least 
upper  bound  exists,  making  D  a  complete  partial  order fcpoj.  A  domain  D  is  called  flat 
when  all  elements  apart  from  the  bottom  element  are  incomparable  with  each  other.  For 
functions  defined  only  on  values  which  do  not  include  compound  data  types  such  as  lists, 
this  type  of  domain  is  sufficient  for  defining  a  consistent  sememtics.  In  a  domain  which  is 
not  flat,  called  a  non-flat  domain,  there  may  exist  an  ordering  among  all  elements.  Com- 
putable functions  between  domains  should  preserve  the  information  ordering  structure  and 
the  limits,  i.e.  they  are  monotonic  emd  continuous.  Given  domains  with  these  reqviirements, 
we  can  construct  domains  such  as  the  Cartesian  product,  the  function  space,  the  separate 
sum,  the  coalesced  sum,  the  reflexive  domain,  the  functional  domain  and  the  powerdomain. 
We  Ccin  now  interpret  recursively  defined  functions  as  least  fixed  points  and  also  compute 
them  by  iteration  from  the  fixed  point  theorem  [74].  If  the  domain  D  is  finite  or  it  has  the 
property  that  aU  chains  are  of  finite  length,  then  the  least  fixpoint  can  be  computed  in  a 
finite  steps  by  iteration.  The  fixpoint  theorem  also  forms  the  basis  for  a  niunber  of  practical 
algorithms  in  abstract  interpretation. 

In  denotationcd  semantics,  the  semantics  of  a  language  is  defined  by  semantic  functions 
mapping  syntax  of  the  language  to  a  suitable  domain  that  captures  certain  computational 
behavior.  Such  semantic  functions  are  defined  so  that  the  meaning  of  any  composite  syn- 
tactic structure  is  expressed  in  terms  of  the  meanings  of  its  iirunediate  constituents.  The 
standard  or  non-standard  semantics  of  any  functional  programming  language  can  be  ex- 
pressed in  terms  of  a  domain  of  objects  and  continuous  fimctions  defined  on  it. 

Abstract  Interpretation 

Abstract  interpretation  is  a  computation  over  some  abstraction  or  approximation  of  a  se- 
mantic domain.  It  is  a  formal  methodology  that  mathematically  approximates  uncom- 
putable  semantic  properties  and  can  be  related  directly  back  to  the  original  denotational 
semantics.  The  correctness  can  be  proved  at  an  abstract  level,  independently  of  operational 
concerns.  From  a  practical  perspective,  abstract  interpretation  also  provides  a  convenient 
methodology  for  expressing  compile-time  amalyses  in  a  relatively  language-independent  man- 
ner. Abstract  interpretation  can  be  used  as  a  general  technique  for  deducing  information 
about  a  program  from  its  text,  by  executing  an  abstract  version  of  the  program  with  ab- 
stract data  and  then  extracting  desired  information  from  the  abstract  results,  instead  of 
actually  executing  the  original  program  and  then  extracting  some  information  via  a  given 
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standard  or  non-standard  semantics.  Abstract  interpretation  has  the  advantages  of  han- 
dling inter-functional  dependency,  recursion,  higher-order  functions,  and  aggregate  data 
structures.  Most  information  the  we  want  to  know  about  the  program  is  essentially  imde- 
cidable.  Therefore  the  issues  of  effective  computability  and  semantic  correctness  or  safety 
become  crucial  for  program  analysis  through  abstract  interpretation. 

Abstract  interpretation  in  the  functional  idiom  analyzes  certain  properties  of  an  expres- 
sion's evaluation  by  first  defining  an  appropriate  abstract  domciin  which  is  usually  much 
simpler  than  the  exact  standard  or  non-standard  semantic  domain,  having  the  minimum 
structure  required  to  encapsulate  these  properties,  and  defining  an  abstract  version  of  each 
function  occurring  in  the  expression  on  the  abstract  domain.  Then  the  abstract  version 
of  each  function  is  applied  to  the  abstractions  of  its  arguments  to  give  a  result,  also  in 
the  abstract  domain,  from  which  the  reqiiired  properties  of  the  function's  real  application 
can  be  deduced.  The  safety  criteria  of  an  abstract  interpretation  is  that  the  real  result  of 
the  application  of  a  function  is  in  the  set  represented  by  the  result  of  the  corresponding 
application  of  the  abstracted  function.  To  be  certain  of  being  correct,  we  must  consider 
every  possible  outcome  of  the  computations  represented  by  a  given  abstract  value,  only  one 
of  which  will  occur  in  any  particular  instance.  Of  course,  by  enriching  the  abstract  domain 
sufficiently,  we  could  represent  any  property  completely  and  make  precise  predictions  pos- 
sible, but  ultimately  we  would  arrive  back  at  the  given  original  standard  or  non-standard 
domain  itself  and  have  to  do  the  whole  computation  anyway.  Normally,  the  applications 
in  the  abstract  domain  are  sufficiently  simple  that  they  can  be  effectively  performed  at 
compile-time.  Thus,  optimizations  relying  on  information  from  abstract  interpretation  can 
be  performed  at  compile-time. 

1.6      Overview  of  the  Thesis 

The  main  reason  that  objects  are  allocated  on  a  heap  is  that  their  lifetime  are  generally 
unknown  at  compile-time.  This  property  of  object  is  called  indefinite  extent.  Information 
about  the  lifetimes  of  objects  can  have  an  important  role  in  storage  management  optimiza- 
tions. Objects  allocated  on  the  heap  could  be  allocated  and  reclaimed  more  efficiently  if 
compilers  sought  to  extract  information  about  their  lifetimes  from  the  program  text  instead 
of  making  worst-case  assumptions.  In  functional  languages  among  many  other  languages, 
exact  information  about  lifetimes  of  objects  is  generally  not  known  at  compile-time,  but  can 
be  known  only  at  run-time.  Such  information,  if  inferred  at  compile-time,  aUows  a  variety 
of  optimizations  that  reduce  the  storage  management  overhead. 
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In  this  thesis,  using  formal  denotational  semantics  and  the  abstract  interpretation  tech- 
nique, we  develop  a  set  of  compile-time  semantic  analyses  for  higher-order,  polymorphic 
functional  languages  with  non-flat  domains,  which  provide  safe  information  about  the  life- 
time of  dynamically-cillocated  objects  during  a  program's  execution.  Based  on  the  infor- 
mation that  is  inferred  statically  through  compile-time  analyses,  we  investigate  a  vari- 
ety of  storage  management  optimization  techniques  that  reduce  the  storage  management 
overhead  in  fimctional  language  implementations  including  bounded-extent  storage  alloca- 
tion, explicit  reclamation,  in-place  reuse,  reference  counting  elimination,  and  block  alloca- 
tion/reclamation. 

1.6.1      The  Functional  Language 

We  introduce  a  simple  higher-order  functional  language  which  is  representative  of  a  class 
of  modern  functional  programming  languages  and  will  be  used  throughout  the  thesis.  It 
is  a  common  observation  that  the  syntax  of  modern  high  level  functional  programming 
languages  are  sugared  versions  of  the  lambda  calcvdus  ([8],  [67]).  We  view  our  analysis  as 
being  performed  at  the  high-level  expression-oriented  source  code,  not  at  low-level  target 
code.  This  view  is  more  portable,  though  the  other  view  has  the  possible  advantage  being 
able  to  use  more  traditional  compiler  optimization  techniques.  Because  the  information  is 
derived  at  the  source  level  it  is  available  during  code  generation  regardless  of  the  target 
language  of  a  given  virtual  machine. 

As  a  model  language,  we  define  a  simple  higher-order  functional  language  whose  syntax 
is  based  on  the  typed  lambda  calculus  augmented  with  constants  that  include  primitive 
functions.  The  language  syntax  is  defined  in  Figure  1.1.  To  support  first-class  functions,  all 
functions  including  primitive  ones  are  curried  and  explicit  lambda  abstractions  are  allowed. 
Nested  groups  of  equations  are  also  allowed.  We  assume  that  aU  identifiers  have  unique 
names,  i.e.  that  the  program  has  been  alpha- con  verted  to  ensure  that  all  bound  variables 
have  been  given  unique  names.  Data  structures  more  general  than  lists,  such  as  trees,  are 
not  dealt  with  here,  however,  the  methods  for  hsts  could  be  extended  to  handle  general  free 
data  types  as  well.  The  model  language  is  defined  this  way  because  any  functional  language 
is  essentially  a  sugared  version  of  the  lambda  calculus,  and  a  number  of  semantic  analysis 
which  we  will  discuss  in  this  thesis  are  applied  to  high-level  source  programs.  We  assume 
that  the  functional  language  adopts  a  strong  static  type  system. 
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c       G     Con  Set  of  Const  ants  (including  primitive  functions) 

=  {...,-1,0, 1,.. .,  true,  false,  nil,  cons,  cair,  cdr,null} 

X      £     Id  Set  of  Identifiers 

e       G     Exp  Set  of  Expressions,  defined  by 

e  ::=  c  \  x  \  ei  +  62  \  Ci  —  €2  \  ei  =  €2  \  if  ei  then  62  else  63 
1  €162  I  lambda(a;).e  |  letrec   xi  =  ei;  ...;  a;„  =  e^;    in  e 

pr     G     Program     Set  of  Programs,  defined  by 

pr  ::=  letrec  a;i  =  ei;  . . . ;  i„  =  €„;    in  e 

Figure  1.1:  The  Syntax  of  Functional  Language 

Notational  Conventions 

Throughout  this  thesis,  the  following  conventional  notations  are  adopted; 

1.  Double  bracket,  |  ],  is  used  to  surround  syntactic  objects, 

2.  Square  bracket  and  map  arrow,  [  h-+   ],  are  used  for  environment  updates, 

3.  Angle  bracket,  (   ),  is  used  for  tupling, 

4.  Subscripts  of  (1),  (2)  and  (3)  are  used  to  denote  the  first,  second  and  third  element  of 
a  tuple,  respectively  and  a  subscript  of  (1,2)  is  used  to  denote  a  pair  consisting  of  the 
first  and  second  elements  of  a  tuple. 

1.6.2      Strict  and  Non-strict  Standard  Semantics 

In  strict  languages,  the  reduction  of  a  function  application  is  performed  in  applicative- 
order  and  thus  the  application  of  a  function  to  its  arguments  results  in  the  arguments 
being  evaluated  before  they  are  passed  to  the  function.  This  section  describes  the  standard 
denotational  semantics  for  the  model  higher-order  functional  language. 

Standard  Semantic  Domains 

The  meaning  of  an  expression  under  the  standard  semantics  is  the  value  of  the  expression 
that  we  usually  think  of,  such  as  a  number,  boolean  value,  function  or  list.  The  standard 
semantic  domain  D,  and  the  domain  of  standard  environments  E,  that  is  a  domain  of 
functions  mapping  identifiers  on  to  their  standard  meaning  are  defined  as  follows: 
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D,     =     22^^         I*  Standard  semantic  domain  */ 

r 

Ef     =     Id  -^  D,     I*  Domain  of  standard  environments  */ 

The  standard  semantic  domain  D,  is  a  separated  sum  domain  consisting  of  a  subdomain 
for  each  type.  The  standard  subdomain  Z?J  for  expressions  of  type  r  is  defined  as  follows: 

jjtnt  _  {_Lj^j} -|- {. .  .^ -:/^  0,  i, . . .}  subdomain  for  integers 

£)booi  _  {i(,^^(}  4- |true,  faise}  subdomain  for  booleans 

£)Ti-.T2  _  £)T,  _^  £)T2  subdomain  for  functions  of  type  rj  — ►  T2 

D;  '"'  =  {_Lr  /i,t}  +  {n/r  '"'}  subdomain  for  lists  of  type  r  /zs< 

Standard  Semantic  Functions 

We  introduce  the  standard  strict  semantic  functions  as  follows: 


5c 

5e 

s. 


P"- 


Con  — >  D,  I*  Standard  semantic  function  for  constants  */ 

Exp  -^  E,  ^>  D,     I*  Standard  semantic  function  for  expressions  */ 
Program  — »  D,       /*  Standard  semantic  function  for  programs  */ 

The  standard  semantic  function  Sc  gives  standard  meaning  to  constants.  The  standard 
semantic  function  Sg  gives  standcird  meaning  to  expressions  in  a  given  standard  environment 
for  identifiers.  The  standard  semantic  function  Spr  gives  standard  meaning  to  programs. 
The  semantic  equations  for  the  standard  semantic  functions  are  expressed  in  Figiire  1.2. 
Here,  the  symbol  of  A,  is  used  to  denote  a  strict  function  abstraction  compared  with  an 
ordinary  notation  of  A. 

{     ±  2/  =   i-T, 

[    (-^a;.e)y     y  7^  J.^^ 

env,  denotes  any  standard  envirormient  in  E,,  and  nullenv,  is  a  standard  envirormient  that 
maps  every  identifier  on  to  the  least  element  of  its  standard  semantic  domain.  Note  that 
5e  and  env'^  is  recursively  defined. 

The  standard  semantic  fimctions  for  non-strict  semantics  are  defined  as  the  standard 
semantic  functions  for  strict  semantics  in  which  A,  is  replaced  by  A. 

1.6.3      Organizations 

The  rest  of  the  thesis  is  organized  as  foDows: 
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SM  =  c,cG  {...,-1,0,1,...} 

5c|true]  =  true 

5c  [false!  =  ^^^se 

5c  [nir '"'I  =  nir'"' 

5c[cons]  =  A,a;.A,y.  pair(x,2/)where  pajr(i,2/)  =  (x,j/) 

5c|car|  =  A, a;.  fiTst(z)where  fixst(a;)  =  ajjij 

5clcdr|  =  X,x.  second(z) where  second(a;)  =  a;(2) 

5c|nullJ  =  \,x.  if  {x  =  nil)  then  true  else  false 

Selcjenv,  =     5clcl 

Selxjenv,  =     env,lxj 

Sele-^  +  e2]env,     =     Seleilenv,  +  Sele2}env, 

Sele-L  -  e2lent;,      =     Selcijenv,  -  Sele2Jenv, 

5e|ei  =  e2Jenvs     =     if  (5e|ei|eni>j  =  5e|e2lem;,)  then  true  else  false 

5elif  Ci  then  62  else  eslenv,     =     if  (5e|eijenu,  =  true) 

then  5e|e2lent)j  else  5ele3]enu^ 
Sele-ie2}env,  =     {Selei]env,){Sele2Jenv,) 

5e[lambda(x).e|env,     =     A,2/.5eIe]ent;,[a;  ^-*  y] 
5£[letrec  xi  =  ei; ..  .;a;n  =  €„;  in  ejenv,     =     5e|elenv^ 

where  env',  =  env,[xi  i-^  5e[ei|ent;j, . .  .,x„  >-+  5e|en|enu^] 


Figure  1.2:  Standard  Semantic  Functions 
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Chapter  2.  Escape  Analysis  :  In  a  higher-order  functional  language,  exact  in- 
formation about  the  lifetime  of  objects,  such  as  bound  variables,  within  a  function 
compared  to  the  lifetime  of  the  activation  of  the  fxmction  call  is  generally  unknown  at 
compile-time,  and  can  only  be  completely  determined  at  run  time.  This  chapter  de- 
scribes a  method  for  computing,  at  compile-time,  safe  information  about  the  relative 
lifetime  of  arguments  and  local  objects  within  a  function  with  respect  to  the  lifetime 
of  an  activation  of  the  function  call.  This  analysis  is  described  for  a  monomorphic, 
strict,  higher-order  functional  language.  The  method  is  based  on  a  compile-time  se- 
mantic analysis  called  escape  analysis  which  provides  information  about  the  lifetimes 
of  objects  within  a  function  with  respect  to  the  lifetime  of  the  activation  of  a  function 
call.  This  information  is  called  the  escapement  of  objects. 

Chapter  3.  Refinements  of  Escape  Analysis  :  For  structured  objects  such  as 
lists  and  trees,  the  escape  information  that  is  obtainable  through  the  escape  analysis 
is  rather  cocirse.  This  chapter  describes  a  method  for  computing  more  refined  escape 
information  for  a  monomorphic,  strict,  higher-order  functional  language.  This  method 
is  based  on  a  compile-time  semantic  analysis  called  refined  escape  analysis  which  is  an 
extension  of  escape  analysis  and  determines  at  compile-time  how  much  of  an  object 
outlives  the  activation  of  the  function  call  in  which  it  is  created. 

Chapter  4.  Reference  Escape  Analysis  :  In  a  higher-order  functional  language, 
exact  information  about  the  lifetime  of  a  dynamically  created  reference  (pointer)  to  a 
heap-aUocated  object  is  generally  unknown  at  compile-time.  This  chapter  describes  a 
method  for  computing,  at  compile-time,  safe  information  about  the  relative  lifetime 
of  dynamically  created  references.  This  method  is  based  on  a  compile-time  semantic 
analysis  called  reference  escape  analysis. 

Chapter  5.  Order-of- Demand  Analysis  :  In  a  non-strict  functional  language 
with  lazy  evaluation,  exact  information  about  the  strictness  of  arguments,  the  order  of 
evaluation  among  arguments,  and  the  evaluation  status  of  arguments  when  demanded 
is  generally  unknown  at  compile-time.  This  chapter  describes  a  method  for  statically 
inferring  a  range  of  information  including  strictness,  evaluation-order,  and  evaluation- 
status  information.  This  method  is  based  on  a  compile-time  analysis  called  order-of- 
demand  analysis  which  provides  safe  information  about  the  order  in  which  the  values 
of  bound  variables  are  demanded. 
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•  Chapter  6.  Polymorphic  Invariance  :  All  the  semantic  analyses  presented  in 
the  preceding  chapters  have  dealt  with  a  higher-order  functional  language  with  a 
monomorphic  type  system.  Using  the  notion  of  polymorphic  invariance,  this  chapter 
describes  a  method  for  applying  escape  analysis,  reference  escape  analysis,  and  order- 
of- demand  analysis  to  a  polymorphic  language  using  the  analysis  techniques  for  a 
monomorphic  language. 

•  Chapter  7.  Extensions  to  Non-strict  Languages  :  Many  modern  functional 
languages  adopt  a  non-strict  semantics  using  the  lazy  evaluation  model,  which  is  more 
powerful  than  strict  languages  in  its  expressiveness.  Using  program  transformation, 
this  chapter  describes  the  extensions  of  escape  analysis  and  reference  escape  analysis 
to  a  non-strict  language. 

•  Chapter  8.  Storage  Management  Optimizations  :  The  escape  information  that 
is  inferred  at  compile-time  from  the  semantic  analyses  which  have  been  described 
in  previous  chapters,  allows  a  variety  of  storage  management  optimizations  in  func- 
tional language  implementations.  Using  the  statically  inferred  escape  information, 
this  chapter  describes  a  variety  of  optimization  techniques  to  reduce  the  storage  man- 
agement overheads  in  functional  language  implementations,  including  stack(bo\inded- 
extent  storage)  allocation,  explicit  reclamation,  in-place  reuse  of  garbage  cells,  refer- 
ence counting  ehmination,  block  allocation/reclamation,  and  improving  generational 
garbage  collection. 

•  Chapter  9.  Related  Work,  Conclusions,  and  Future  Work  :  This  chapter 
surveys  some  previous  work  related  to  the  work  presented  in  this  thesis,  summarizes 
the  contributions  of  this  thesis,  and  suggest  some  further  research  in  this  area. 


17 


Chapter  2 


Escape  Analysis 


In  higher-order  functional  languages,  exact  information  about  the  relative  lifetime  of  an 
object  with  respect  to  the  lifetime  of  the  activation  of  the  function  call  that  creates  the 
object  is  generally  unknown  at  compile-time.  When  storage  is  allocated  for  such  an  object, 
it  is  generally  allocated  from  a  heap.  The  object  is  then  reclaimed  using  some  kind  of 
automatic  reclamation  method.  Lifetime  information,  if  inferred  at  compile-time,  can  be 
useful  for  efficient  management  of  storage  for  these  objects  at  run-time. 

In  this  chapter,  we  present  a  method  for  computing  at  compile-time  safe  information 
about  the  relative  lifetime  of  arguments  and  local  objects  defined  within  a  function  with 
respect  to  the  lifetime  of  an  activation  of  the  function  call  for  a  higher-order,  monomorphic, 
strict  functional  language.  This  method  is  based  on  a  compile-time  semantic  analysis  called 
escape  analysis  which  provides  information  about  the  lifetimes  of  such  objects  with  respect 
to  the  activation  of  the  function  call  that  creates  them.  This  property  is  called  escapement  of 
objects.  First,  using  denotational  semantics  and  abstract  interpretation,  we  introduce  a  non- 
standard denotational  semantics  called  escape  semantics  that  describes  the  actual  escape 
behavior,  but  is  incomputable  at  compile  time.  An  abstraction  method  for  approximating 
the  exact  escape  semantics  which  is  both  safe  with  respect  to  the  exact  escape  semantics  and 
computable  at  compile-time  is  then  presented.  Based  on  this  abstract  escape  semantics,  we 
describe  the  escape  testing  algorithms  which  determine  escape  information  for  functions  that 
holds  true  for  every  possible  application  of  the  function,  and  also  escapement  information 
that  holds  for  a  particular  call  to  the  function.  Another  safe  and  computable  abstraction 
of  the  exact  escape  semantics,  called  improved  abstract  escape  semantics,  that  improves  the 
precision  of  escape  information  that  is  obtainable  through  the  abstratt  escape  semantics 
is  also  presented  using  the  position  information  of  objects  in  a  list  structure.   Finally,  the 
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Figiire  2.1:  Escapement  of  Objects 
complexity  of  the  escape  analysis  is  discussed. 

2.1      Escapement  of  Objects 

The  lifetime  of  an  object  defined  in  a  program  is  the  period  from  the  time  it  is  created  to 
the  time  it  will  be  no  longer  used.  The  notion  of  relative  lifetime  is,  given  a  pair  of  objects 
0\  and  O2  being  built  during  a  program's  execution,  whether  the  object  Oi  has  a  greater 
lifetime  with  respect  to  the  lifetime  of  the  other  object  O2  or  not.  The  notion  of  relative 
lifetime  can  be  applied  to  any  pair  of  objects  that  exist  during  a  program's  execution.  We 
are  particularly  interested  in  the  case  when  one  object  is  either  an  argimient  to  a  function 
or  a  locally  defined  object,  and  the  other  object  is  an  activation  (record)  of  the  function 
call,  as  is  shown  in  Figure  2.1.  That  is,  given  a  function,  we  are  interested  in  whether 
an  argument  or  a  locally  defined  object  escapes  the  activation  of  the  function  call  or  not. 
Note  that  the  escaping  argiunent  or  locally  defined  object  needs  to  be  retained  after  the 
activation  to  the  fimction  call  ends.  We  formally  define  the  notion  of  escapement  of  objects 
with  respect  to  a  function. 

Definition  2.1  (Global/Local  Escapement)  Given  a  function  /  with  n  formal  param- 
eters and  771  locally  defined  objects,  the  i  formal  parameter  or  locally  defined  object  is 
said  to 

•   escape  the  function  call  to  /  globally  if,  in  some  possible  application  of  /  to  n  ar- 
guments, some  or  all  of  the  corresponding  actual  parameter  or  local  object  outlives 
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the  activation  of  the  function  call  (by  being  contained  in  the  result  of  the  function 
application). 

•  escape  the  function  call  to  /  locally  in  (/  Cj  ...e„)  if,  in  the  particular  function 
application  of  (/  ej  . . .  e„),  some  or  all  of  the  corresponding  actual  parameter  or  local 
object  outlives  the  activation  of  the  particular  fimction  call  to  /  (by  being  contained 
in  the  result  of  the  function  application  of  (/  ej   ...€„)). 

The  global  escape  information  about  a  function  can  be  safe  in  any  context  in  which  the 
function  is  called.  In  this  sense,  it  is  the  property  of  function  regardless  of  its  apphcation 
context.  Thus,  the  global  escape  information  is  safe  for  a  function  in  a  particular  context, 
but  it  may  be  weaker,  in  terms  of  its  usefulness,  than  the  escape  information  of  a  function 
in  a  particular  context.  The  local  escape  information  about  a  function  is  the  property  of 
the  function  in  a  particular  context  rather  than  the  property  of  the  function  alone. 

From  the  escape  information  about  a  parameter  or  local  object  with  respect  to  a  func- 
tion, we  can  deduce  information  about  its  lifetime:  If  a  parameter  or  local  object  does  not 
escape  the  function  call  to  /  globally  then  we  can  conclude  that  the  hfetime  of  the  corre- 
sponding argument  or  local  object  that  is  created  inside  the  function  is  confined  within  the 
lifetime  of  the  function  call  in  any  possible  application  of  /  unless  it  is  shared  elsewhere. 
Similarly,  if  it  does  not  escape  the  function  call  to  /  locally  in  a  particular  context  of 
(/  Ci  . .  .e„)  then  we  can  conclude  that  the  lifetime  of  the  corresponding  argument  or  local 
object  that  is  created  inside  the  function  is  confined  within  the  lifetime  of  that  particular 
function  call  unless  it  is  shared  elsewhere. 

Such  escape  information  is  generally  unknown  at  compile-time  in  higher-order  fimctional 
languages.  We  will  develop  a  method  for  monomorphic,  higher-order,  strict  functional 
languages  to  answer  the  following  questions  at  compile-time: 

•  Given  a  function,  which  parameter  or  local  object  that  is  defined  inside  the  function 
escapes  the  function  call  globally  ? 

•  Given  a  function  in  a  particular  application  context,  which  parameter  or  local  object 
that  is  defined  inside  the  function  escapes  that  particular  function  call  locally  ? 

A  naive  approach  would  be  through  syntactic  analysis.  However,  such  syntax-based  ap- 
proach is  not  sufficient  for  specifying  higher-order  escapements  of  objects.  We  formalize  the 
escape  model  through  denotational  semantics  and  then  derive  a  safe,  computable  analysis 
using  the  abstract  interpretation.  First,  we  define  a  non-standard  denotational  semantics 
that  captures  the  exact  operational  notion  of  escapements.    Since  the  functional  language 
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we  are  dealing  with  allows  higher-order  functions,  the  result  of  an  expression  may  be  a 
function.  Such  a  function,  represented  by  a  closure,  has  two  important  characteristics  with 
respect  to  the  escape  semantics: 

1.  The  closure  is  an  object  itself.  We  may  be  interested  in  whether  the  closure  escapes 
or  not,  or  we  may  be  interested  in  another  object  that  is  captured(bound)  within  the 
closure.  Thus,  the  value  of  an  expression  returning  a  fimction  must  indicate  whether 
an  interesting  object  has  escaped. 

2.  A  fimction  value  may  be  applied  to  arguments  (which  may  themselves  escape  from 
the  application).  Therefore,  in  the  non-standard  escape  semantics,  the  escape  value 
of  a  function  must  include  its  behavior  as  a  function. 

Thus,  the  value  of  an  expression  in  the  escape  sen[iantics  is  an  element  of  a  non-standard 
semantic  domain  and  must  have  two  components.  First,  it  must  contain  information  about 
what  is  contained  within  the  value  of  the  expression.  Second,  it  must  capture  the  functional 
behavior  of  the  expression  over  the  values  in  the  escape  semantic  domain.  We  then  define  a 
suitable,  i.e.  safe  and  computable,  abstraction  of  the  exact  non-standard  semantics  that  can 
be  computed  at  compile  time  but  provide  less  precise  information.  Then  we  describe  how 
the  abstract  escape  semantics  can  be  used  to  gain  global  and  local  escape  information.  We 
also  describe  another  abstraction  of  the  exact  escape  semantics  that  provides  more  precise 
escape  information  but  at  a  higher  cost. 

2.2      Exact  Non-standard  Escape  Semantics 

We  introduce  an  exact,  but  incomputable,  non-standard  denotational  semantics  called  es- 
cape semant2cs,  which  exactly  describes  the  actual  operational  notion  of  escapement  for 
functions  in  a  program.  Since  the  exact  escapement  during  a  program's  execution  depends 
on  the  standard  values  themselves,  for  example,  the  standard  value  of  the  predicate  part  of 
the  conditional  will  determine  which  alternative  will  be  taken,  any  exact  escape  semantics 
needs  to  contain  the  information  about  the  standard  meaning  as  well  as  escape  information. 
Each  parameter  or  local  object  of  a  function  will  be  analyzed  separately  to  determine 
its  escape  behavior.  We  say  that  a  parameter  is  interesting  if  it  is  the  one  whose  escape 
behavior  we  are  trying  to  determine.  Thus,  our  escape  semantics  is  defined  in  terms  of  a 
single  interesting  object. 
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Figure  2.2:  The  Basic  Escape  Domain 

Representing  Escape  Information 

The  first  step  in  describing  a  non-standard  escape  semantics  is  to  define  a  suitable  non- 
standard escape  semantic  domain.  A  domain  is  used,  rather  than  a  set,  to  guarantee  that 
a  recursive  function  always  has  a  solution.  The  meaning  we  will  attach  to  the  syntax  is  the 
information  about  containment  of  interesting  objects.  For  each  expression,  its  corresponding 
value  in  the  escape  semantic  domain  should  be  able  to  tell  whether  no  part  of  an  interesting 
object  is  contained  in  the  value  of  the  expression  ("non-escape"),  or  whether  some  part  of 
or  all  of  an  interesting  object  is  contained  in  the  value  of  the  expression  ("escape").  Thus, 
under  our  non-standard  escape  semantics,  we  represent  the  meaning  of  an  expression  as  a 
pair,  called  an  escape  pair  (in  the  style  of  [43]), 

1.  whose  first  element  denotes  the  containment  of  an  interesting  object  in  the  value  of 
the  expression,  and 

2.  whose  second  element  denotes  the  functional  behavior  of  the  expression  defined  over 
the  escape  pairs  when  the  expression  itself  is  applied  to  another  expression. 

For  a  non-list  type  expression,  the  corresponding  value  in  the  non-standard  escape  semantic 
domain  Do  has  two  components;  The  first  component  is  an  element  of  a  domain  called  a 
basic  escape  domain,  Bo  which  is  a  two-element  domain  of  0  and  1  ordered  by  0  C  1  as 
shown  in  Figure  2.2.  The  interpretation  of  elements  of  Bo  is  defined  as  follows: 

•  1    :    Some  part  of  or  all  of  an  interesting  object   is  contained  in  the  value  of  the 
expression. 

•  0  :  No  part  of  any  interesting  object  is  contained  in  the  value  of  the  expression. 

The  second  component  is  a  function  over  Do,  whose  meaning  is  the  functional  behavior  of 
the  expression  defined  over  the  escape  values  when  the  expression  c  is  applied  to  another 
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expression.  For  expressions  which  have  no  higher-order  behavior,  such  as  non-function 
type  expressions,  err,  denoting  a  function  that  can  never  be  applied,  is  used.  For  a  list 
type  expression,  the  corresponding  value  in  the  escape  semantic  domain  is  a  list  of  the 
corresponding  values  of  its  components  in  the  escape  semantic  domain. 

Escape  Semantic  Domains 

Do,  the  escape  semantic  domain,  and  Eo,  the  domain  of  enviroimients  mapping  identifiers 
to  their  escape  meanings,  are  completely  defined  as  follows: 

Do     =     22^0  I*  Escape  semantic  domain  */ 

T 

Eo     =     Id^f  Do     /*  Domain  of  escape  environments  */ 

The  escape  semantic  domain  Dg  is  a  separated  sum  domain  made  up  of  the  subdomains  for 
each  type  defined  by  D^.  The  escape  subdomain  D^  for  expressions  of  type  r  is  defined  as 
follows  (in  the  style  of  [18]): 

j-fint  _  Bo  X  {err}  subdomain  for  integers 

£fbooi  _  Bo  X  {err}  subdomain  for  booleans 

£)Ti^T2  _  ^^  ^  i^jjTi  _^  j-)T2^  subdomain  for  functions  of  type  Tj  — >  T2 

j)ri„t  ^  {BoX  {err})  +  {Dl  X  Dl'"^)  subdomain  for  lists  of  type  t /25< 

The  escape  subdomains  for  integers  and  booleaji  values  is  the  cartesian  product  of  Bo  and 
err,  which  is  ordered  as  follows: 

Vu,  V  6  I?r'  "'  ^""'^    uCv\f^  (u(i)  C  v^,^)  and  (u^^)  Q  y(2)) 

The  escape  subdomain  for  function  of  type  tj  — >  T2  is  the  cartesian  product  of  Bo  and  the 
function  space  Z)^'  — »  Dl^ .  The  function  space  of  Z)p  — >  Z)^^  is  ordered  as  follows: 

^f,geD:'  -^Dl^,    fQgif[ydeDl',f^,^dng^^)d 

The  escape  subdomain  for  hsts  of  type  r  list  is  the  simi  domain  of  the  cartesian  product 
of  Bo  and  err,  and  the  cartesian  product  of  D^  and  Z)j'"',  whose  ordering  is  defined  as 
follows: 

yu,veDl'''',    uCvm(    \_\   p)Q(\_\   q) 

P  ill  II  q  in  u 

where  p  in  it  denotes  that  p  is  an  escape  pair  in  u. 

The  bottom  elements  ±,„,  and  Ibooi  in  the  escape  subdomains  for  integers  and  booleans 

are  (0.  err),  respectively.  The  bottom  element  ±j.^-.t2  in  the  escape  subdomain  for  functions 


of  type  Ti  — >  T2  is  (0,  Aa^.l^j).  The  bottom  element  A-t  list  in  the  escape  subdomain  for  lists 
of  type  r  list  is  (0,  err). 

The  top  elements  T,„/  and  Tbooi  in  the  escape  subdomains  for  integers  and  booleans 
are  {I, err),  respectively.  The  top  element  Jr^-,T2  in  the  escape  subdomain  for  functions 
of  type  Ti  — »  T2  is  (1,  Xx.T.r2)-  The  top  element  Tt  ii,t  in  the  escape  subdomain  for  lists  of 
type  T  list,  however,  does  not  exist. 

Escape  Semantic  Functions 

We  now  introduce  the  non-standard  escape  semantic  functions  to  give  the  syntax  the  escape 
meaning  as  follows: 


p^ 


Con  — >  Do  /*  Escape  semantic  function  for  constants  */ 

Exp  —*  Eo  —>  Do     I*  Escape  semantic  function  for  expressions  */ 
Program  — ♦  Do       /*  Escape  semantic  function  for  programs  */ 

The  escape  semantic  function  Oc  gives  the  non-standard  escape  meaning  to  constants.  The 
escape  semantic  function  O^  gives  the  non-standard  escape  meaning  to  expressions  in  a  given 
escape  envirormient  for  identifiers.  The  escape  semantic  function  Opr  gives  the  non-standard 
escape  meaning  to  programs  The  semantic  equations  for  the  escape  semantic  functions  are 
expressed  in  Figure  2.3. 

Since  an  interesting  object  is  definitely  not  contained  in  constants  such  as  integers, 
booleans  and  nil,  and  also  such  constants  can  never  be  applied,  their  values  in  escape 
semantics  are  given  by  (0,e7'7').  The  value  of  cons  under  escape  semantics,  when  applied 
to  two  arguments,  simply  returns  a  pair  consisting  of  the  values  of  the  two  arguments. 
Since  cons  is  curried,  the  result  of  applying  cons  to  a  single  argument  returns  a  closure 
containing  that  argument.  The  values  of  car  and  cdr  under  escape  semantics,  when  applied 
to  a  list  whose  value  is  a  pair  in  Z?J  ,  returns  the  first  and  second  components  of  the  pair, 
respectively.  The  value  of  null  under  the  escape  semantics,  when  applied  to  a  list,  returns 
the  escape  values  of  constant  boolean  values,  namely  (0,er7-). 

enVo  is  any  exact  escape  environment  in  Eg.  In  order  to  return  the  actual  escape  value 
of  each  expression,  we  must  be  able  to  determine  which  branch  of  the  conditional  primitive 
if  would  be  evaluated  at  run-time.  Here,  for  convenience,  we  instead  resort  to  an  oracle 
called  Oracle  to  choose  the  appropriate  branch  of  the  if.  Under  the  escape  semantics, 
the  value  of  a  lambda  expression  which  denotes  a  function  reflects  whether  an  interesting 
object  is  contained  in  the  resulting  closure  it  as  a  free  identifier,  as  well  as  its  functional 
behavior  when  it  is  applied.    Note  that  free  identifiers  are  treated  separately  according  to 
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whether  they  are  of  a  list  type  or  a  non-list  type,  nullenvo  is  an  escape  environment  that 
maps  every  identifier  to  the  least  element  of  its  escape  semantic  domain. 

Uncomputable  at  compile-time 

Oracle,  which  is  of  type  Exp  — >  {true,  faise},  is  used  to  resolve  the  exact  escape  behavior 
of  the  conditional  expression  if.  Since  the  branch  of  the  if  that  is  actually  taken  depends 
on  the  standard  value  of  its  predicate  expression,  this  oracle  must  rely  on  the  standard 
semantics  somehow.  One  way  of  achieving  this  is  by  having  the  exact  escape  semantics 
directly  compute  the  standard  meanings  as  well  as  the  escape  meanings  of  expressions,  i.e. 
operate  on  elements  in  the  domain  D,  X  Do-  Thus,  any  exact  escape  semantics  should 
contain  all  the  standard  meanings  and  all  the  escape  meanings.  Since  the  interpretation 
of  programs  imder  the  standard  semantics  is  uncomputable,  interpretation  under  the  exact 
non-standard  escape  semantics  is  not  computable  at  compile  time.  In  fact,  from  the  point 
of  view  of  information  contents,  the  standard  semantics  can  be  considered  as  an  abstraction 
of  the  exact  escape  semantics. 

2.3      Abstract  Escape  Semantics 

The  escape  semantics  presented  in  the  last  section  specifies  exact  escape  information  about 
functions  in  a  program.  But  it  is  not  suitable  as  a  basis  for  compile-time  analysis  for  two 
reasons: 

1.  Since  conditionals  cannot  be  evaluated  at  compile-time  and  there  is  no  such  thing  as 
an  oracle  at  compile-time,  there  is  no  way  to  know  which  branch  of  a  conditional  if 
will  be  executed. 

2.  We  cajonot  know  at  compile  time  exactly  which  and  how  many  elements  each  list  will 
contain.  When  some  part  of  a  Ust  is  taken  by  either  car  or  cdr,  there  is  no  way  to 
know  exactly  which  value  is  removed  from  the  list  and  which  values  remain  in  the  list. 

For  use  by  a  compiler,  we  need  a  suitable  escape  semantics  that  will  guarantee  termination 
and  yet  still  provide  useful  and  safe  information  with  respect  to  the  exact  escape  semantics. 
To  get  some  computable  escape  semantics,  we  need  to  somehow  abstract  or  approximate 
the  exact  escape  semantics.  In  general,  abstraction  or  approximation  of  an  exact  standard 
or  non-standard  semantics  can  be  done  by  abstracting  either  its  domains  or  its  primitive 
functions  or  both.  Generally,  there  can  be  a  range  of  possible  computable  abstractions,  all 
of  which  are  safe  but  which  may  vary  in  their  information  content  and  their  complexities. 
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Oclcj  =  {0,err),    ce  {..., -1,0,1,. ..,true,false^ir'"'} 

Oclconsj  =  {0,A2:.(2;(i),  Ay.  pair(i,y))) 

Oclcarl  =  (0,Az.first(i)) 

Oelcdr]  =  (0,Aa;.  second(x)) 

Oelnulll  =  {0,Xx.(0,err)) 

Oelcjenvo  =     Oclcj 

Oelxjenvo  =     envolxj 

Oe[ei  +  e2}enVo     =     (0,  err)  /*  same  for  e-[  -  63  and  ei  =  e^  */ 

Oefii  ei  then  62  else  esjenvo     =     if  Oracle(ei)  then  OeIe2lc^Uo 

else  OelezjenVo 
OeleiCijenVo  =     {OeleijenVo)^^^)  iOele2JenVo) 

Oella^hdai{x).ejenvo     =     (F,  Aj/.Oe|e|enUo[a;  i->  y]) 

where 

V  =  OU(         U        ienv,lzj\,^)U{     \J     (  |J         p(,))), 

zeF"""-'"'  ief'"   pin  (enu<,[z]) 

p  in  (enz^oKzJ)  denotes  that  p  is  an  escape  pair  in  enVol^J, 

jpnon-hst  _  g^j.  of  non-list  type  free  identifiers  in  (lambda(2;).e),    and 

jp'"'  =  Set  of  list  type  free  identifiers  in  (lainbda(z).e). 

Oe[letrec  zi  =  ei;...;i„  =  e„;ine]enuo     =     Oelejenv'^ 

where  env'^  =  enVo[xi  t->  Oeleijenv'^, . . . ,Xn  •-»  Oe|e„Ient'^] 

C^prlp^"!     =     Oelprjnullenvo 

Figure  2.3:  Escape  Semantic  Functions 
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Figure  2.4:  The  Abstract  Basic  Escape  Domain 

Abstracting  Escape  Semantic  Domains 

We  present  a  suitable,  i.e.  safe  and  computable  but  less  complete,  abstraction  of  the  exact 
escape  semantics  defined  in  the  last  section  that  allows  an  approximation  of  the  exact  escape 
behavior  to  be  found  at  compile-time. 

We  safely  approximate  the  exact  escape  semantics  by  abstracting  escape  semantic  sub- 
domains  for  list  type  expressions  and  by  approximating  escape  semantic  functions.  For 
each  expression,  its  corresponding  value  in  the  abstract  escape  semantic  domain  tells  that 
no  part  of  an  interesting  object  is  contained  in  the  value  of  the  expression  ("non-escape"), 
or  that  some  part  of  an  interesting  object  may  be  contained  in  the  value  of  the  expression 
("possible  escape").  The  abstract  basic  escape  domain  Bo  is  a  two-element  domain  of  0  and 
1  ordered  by  0  C  1,  and  is  similar  to  the  basic  escape  domain  Bo  as  shown  in  Figure  2.4. 
But,  the  interpretation  of  elements  of  Bo  is  defined  differently  from  the  interpretation  of 
elements  in  Bo  as  follows: 

•  1  :  Some  part  of  or  ^lll  of  an  interesting  object  Tnay  be  contained  in  the  value  of  the 
expression. 

•  0  :  No  part  of  any  interesting  object  is  contained  in  the  value  of  the  expression. 

Note  that  the  most  precise  information  appears  at  the  bottom  of  the  domain  and  the  least 
precise  at  top  of  the  domain.  The  0  and  1  may  be  thought  of  as  defining  sets  of  possible 
values  of  the  expressions,  and  the  domain  is  ordered  by  the  subset  ordering.  Abstraction 
of  the  escape  semantic  subdomains  for  list  type  expressions  is  done  by  representing  lists  as 
finite  objects,  i.e.  by  combining  the  escape  pairs  of  all  its  elements  into  a  single  escape  pair. 
The  abstract  escape  semantic  domain  Do  is  an  abstraction  of  Do,  and  the  domain  Eo  is 
abstract  escape  environments  Eg.  They  are  defined  as  follows: 
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p^ 


Do     =     yj-Dp  /*  Abstract  escape  semantic  domain  */ 

T 

Eo     =     Id—y  Do     /*  Domain  of  abstract  escape  environments  */ 

The  abstract  escape  subdomain,  D^  for  expressions  of  type  r  is  defined  as  follows: 

£ftnt  _  ^^  X  {err}  abstract  subdomain  for  integers 

£)boot  _  B^  X  {err}  abstract  subdomain  for  booleans 

£)Ti—T2  _  Bo  X  (X)p  —y  Dl^)  abstract  subdomain  for  functions  of  type  tj  — +  T2 

£)T  hat  _  ^T  abstract  subdomain  for  lists  of  type  r  list 

Note  that  the  abstract  escape  subdomain  Dl  ''^'  is  the  same  as  the  subdomain  D^. 

Abstracting  Escape  Semantic  Functions 

We  now  introduce  an  abstract  escape  semantic  functions  to  give  the  syntax  the  escape 
meaning  as  follows: 

Con  — >  Do  /*  Abstract  escape  semantic  function  for  constants  */ 

Exp  -^  Eo  —y  Do     I*  Abstract  escape  semantic  function  for  expressions  */ 
Program  — »  £)<,       /*  Abstract  escape  semantic  function  for  programs  */ 

As  an  abstraction  of  the  exact  escape  semantic  functions,  the  abstract  escape  semantic 
functions  are  given  in  Figure  2.5. 

The  abstract  value  of  cons  returns  a  single  escape  pair  that  is  approximating  a  list  of 
escape  pairs.  The  abstract  values  of  car  and  cdr  just  retxirns  their  cirguments,  respectively. 
The  abstraction  for  the  conditional  expression  if  no  longer  makes  an  appeed  to  the  Oracle, 
but  rather  takes  the  least  upper  bound  of  the  escape  values  of  both  branches.  Notice  that 
the  definition  of  the  abstract  escape  semantic  function  O^  on  the  expression  of  lambda(2-).e 
is  considerably  simpler  than  the  exact  escape  semantic  fimction  O^-  efiVg  is  any  abstract 
escape  envirormient  in  Eg^  and  the  nullenVo  is  an  abstract  escape  envirormient  that  maps 
every  identifier  on  to  the  least  element  of  its  abstract  escape  semantic  domain. 

Safety 

The  actual  escape  property  of  the  program  that  is  being  approximated  must  imply  the 
escape  information  gathered  from  the  abstract  escape  semantics.  The  safety  of  the  abstract 
escape  semantics  means  that  the  interpretation  under  this  abstract  semantics  will  never 
produce  wrong  escape  information  with  respect  to  what  is  obtained  by  the  interpretation 
under  the  exact  escape  semantics. 

28 


OM 

Oe[nil^'"*] 
Oc[cons] 
Oclcar] 
Oelcdrl 


=  (0,err),    c  e  {..., -1,  0, 1, ...,  true,  false} 

=  ±T  (  The  bottom  element  in  D^  ) 

=  (0,  Aa;.(x(i),  Ay.zUr/)) 

=  (0,Ax.x) 

=  (0,Az.x) 

=  {0,Aa:.(0,e7-7-)) 


Oe|ei  +  e2|ent;o     =     (0,  err)  /*  same  for  ei  -  62  and  ei  =  62  */ 
Oe[if  ei  thene2  else  ealen^o     =     {dele2}enVo)\J  {OelesjehVo) 

deleie2JehVo  =     {Oeleijenv 0)1^2)  {Oeleijehvo) 

Oe|lambda(a;).ejenvo     =     {V,\y.delejenvo[x  >-^  y]) 

where 

y  =  OU(|J(en7;42l)(i))and 

F  =  Set  of  aU  free  identifiers  in  (lambda(s).e). 
Oe[letrec  xi  =  ei;...;Xr.  =  e„;in  eJeTiUo     =     O^lejenv'^ 

where  ent/  =  ehvo{x-i  1^  Oeleijeni;^, . . .,  z„  h^  Oe|e„Ient)[,] 

Figure  2.5:  Abstract  Escape  Semantic  Functions 
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Definition  2.2  (Non-standard  Application)  Let  NAP„  be  an  apply  operator  for  ele- 
ments in  the  non-standeird  semantic  domains  Do  and  Do-,  defined  as  foUows:  For  ep,  epi, . . . ,  ep„ 
e  Do  and  Do-, 

^TAT,  I  ,  def  J    ep  n  =  0 

NAP„(ep,epi,...,ep„)  =    < 

[   NAP„_i(ep(2)epi,ep2,...,ep„)     n>0 

We  introduce  the  notion  of  safety  with  respect  to  escape  information  which  relates  the 
exact  escape  semantics  to  the  abstract  escape  semantics.  Let  u  and  v  be  values  of  an 
expression  e  of  type  r  or  r  list  in  the  abstract  escape  domain  Do  and  the  exact  escape 
domain  Do,  respectively.  Let  n  be  the  number  of  arguments  that  type  r  can  take  before 
returning  a  value  of  a  non-function  type.  We  say  that  the  abstract  escape  semantic  value 
u  is  a  safe  approximation  (with  respect  to  exact  escape  information)  of  the  exact  escape 
semantic  value  v  iff 

(  U  P(i))  C  NAPfc(u,5i,...,5fc)(i) 

pinNAPfc(v,«i,...,tt) 

for  all  t  <  n  where  5^  is  a  safe  approximation  of  <,  for  aU  i  <  k. 

Theorem  2.1  (Safety)  For  any  expression  e,  and  environments  enVo  and  envg  such  that 
for  all  y,  envoly}  is  a  safe  approximation  of  envoly},  OgleJenVo  is  a  safe  approximation 
of  Oele^enVo-  Thus,  the  escape  information  obtained  by  the  exact  escape  semantics  implies 
the  escape  information  obtained  by  the  abstract  escape  semantics. 

Proof  :  We  can  prove  by  structural  induction  on  expression  e. 
I.  Base  Case: 

1.  e  =  c:  Oelcjehvo  =  Odcj  and  Oelcjenvo  =  Odcj.  For  c  G  {...  ,-1,0,1 true. 

false,  nil,  null  }  ,  Odcj  —  Oc^cj  =  (0,err).  For  c  =  cons,  it  holds  because  Xi  U  X2  is 
safe  for  a  list  consisting  of  j/i  and  1/2  if  a^i  and  X2  are  safe  for  t/i  and  y2,  respectively.  For 
c  6  {car,    cdr  },  it  holds  because,  if  x  is  safe  for  j/,  x  is  clearly  safe  for  both    first(j/)  and 

second(T/). 

2.  e  =  x:  Oelxjenvo  =  envolxj  and  OelxjenVo  =  enfofa;].  Since,  for  all  3/,  eniiolyj  is 
safe  for  eni^o |j/|,  it  clearly  holds. 

n.  Structural  Induction  Step:  Assmne  that  OefejeriVo  is  safe  for  OeJeJenUo  for  expressions 
such  as  Co-,  Ci,  62,  £3  and  e„  (structural  induction  hypothesis).  Then,  we  show  that  Oel^I^'^^'o 
is  safe  for  Oefejenvo  for  e  =  e-^  +  €2,  if  ei  then  62  else  63,  6162,  lambda(z).ei,  and 
letrec  Xi  =  ei; . . .;  z„  =  e^;  in  cq  as  follows: 
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1.  e  =  ei+e2:  Oelei +e2}enVo=  Oelei  +  e2}enVo  ={0,err).  Similarly,  it  holds  for  Ci  -  62 
and  Ci  =  62- 

2.  e  =  if  Ci  then  62  else  63:  Oe[if  ^i  then  62  else  esjeniv  =  ()e[e2leni;o  U 
Oele2lenvo.  Oe|if  ei  then  62  else  esjenVo  is  either  Oe[e2le»i^^o  or  Oele2ienVo  depending 
on  the  standard  semantic  value  of  ci.  In  either  case,  by  the  structural  induction  hypothesis, 
Oelejenvo^  Oe|e|envo. 

3.  e  =  6162:  deleie2}enVo=  (Oelei|ent7o)(2)  {dele2JenVo).  Oe|eie2|enUo=  (OeIeilenVo)(2) 
(Oe|e2lent;o).  By  the  structural  induction  hypothesis,  (Oeleijenvo)  and  [OeleiJenVo)  are 
safe  for  [OelsiJenVo]  and  (Oe|e2]eni;o),  respectively.    Then,  by  the  definition  of  safe,  it 
holds. 

4.  e  =  lainbda(x).ei:  Oellajobda.{x).e}ehvo=  {V,Xy.Oele}envo[x  1— >  y]).  Oe[lambda(s).e] 
enVo=  {V,  Xy.OeleJenvo[x  1— »  y]).  Since,  for  all  y,  envoly}  is  safe  for  ent;o|j/|,  we  have  that  V 
Q  V.  By  the  structural  induction  hypothesis,  Oel^l^'^^'ola:  1-^  y]  is  safe  for  Oele]ent;o[a;  1— »  y]. 

5.  e  =  letrec  xi  =  cj; . . . ;  2;„  =  e„;  in  eo:  Odletzec  Xi  =  ej; . . . ;  Xn  =  e^;  in  €o}envo  = 
Oeleojefiv'^  where  env'^=  enVo[xi  i->  Oeleijent;^].   Oe|letrec  ij  =  Ci;...;  x^  =  e„;  in  CqI 
ent;o=  Oe[eoIeni;^  where  env'g=  enVo[xi  >-^  Oeleijenv'g].    Here,  env'  and  env'  are  recur- 
sively defined.    We  prove  that  efiv'g  is  safe  for  env'^  for  all  y  by  fixpoint  induction  on  the 
enviroimients  eiiv'^  and  env'^  as  follows: 

1.  Base  Case:  The  first  approximation  envo  oi  env'^  is  enVo[xi  i— >  ±].  The  first  approxi- 
mation env}  o{ env'g  is  ent;o[x,-  1— »  ±].  Thus,  for  all  y,  envj^'lyj  is  safe  for  env}  [y]. 
Then,  by  the  structural  induction  hypothesis,  Oeleojehv'^.  is  safe  for  Oelcole^'-'o- 

2.  Fixpoint  Induction  Step:  Assimne  that,  for  some  fixed  fc  >  0,  the  A;""  approxima- 
tion env}  'lyj  is  safe  for  env}  {yj  for  aU  y.  (fixpoint  induction  hypothesis)  Then, 
The  {k  +  1)*''  approximation  env}''^^'  is  envolx^  h-+  de|ei|enuj'''],  and  env}'  is 
enz;o[xi  i-»  Oe|e,|enz;o  ].  By  the  structural  induction  hypothesis,  Oeleijenv}'''  is  safe 
for  Oelei}env}  .  Thus,  for  all  y,  efiv}  '^^'{yj  is  safe  for  env}  |j/J.  Then,  by  the 
structural  induction  hypothesis,  Oe[eo|eni;^  is  safe  for  Oeleojent;^. 

D 

Termination 

A  compiler  should  terminate  on  every  valid  program.  In  order  for  any  compiler  which  uses  an 
analysis  based  on  the  abstract  escape  semantics  to  be  effective,  the  interpretation  under  the 
abstract  escape  semantics  must  also  be  effective.  The  effectiveness  of  interpretation  under 
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the  abstract  escape  semantics  means  that  it  terminates  on  every  valid  program.  When  the 
abstract  version  of  a  function  derived  by  the  abstract  escape  semantics  is  non-recursive,  ter- 
mination is  guaranteed.  Recursive  fimctions,  however,  derive  recursively  defined  functions 
as  their  abstract  versions.  From  the  fixed  point  theorem  of  domain  theory,  the  recursive 
function  is  given  by  the  least  fixed  point  of  the  corresponding  higher-order  functional.  That 
is,  for  the  function 

where  /  is  of  type  r  and  F  is  a  functional  corresponding  to  the  body  of  /,  the  meaning  of 
/  is  defined  to  be  the  least  function  satisfying  the  above  equation  and  the  least  fixpoint  / 
can  be  found  as  follows: 

i~-*oo 

where  F°{x)  =  x  and  F'{x)  =  F(F'"^(a;))  and  i.,-  is  the  bottom  element  of  the  domain  of 
type  T,  i.e.  D^ . 

Theorem  2.2  (Termination)  For  any  (finite)  program  pr  G  Program,  Oprlpr}  is  com- 
putable, i.e.  always  terminates  in  finite  number  of  steps.  Thus,  interpretation  of  pr  under 
the  abstract  escape  semantics  terminates. 

Proof  :  We  can  prove  that  the  interpretation  of  a  program  under  the  abstract  escape 
semantics  will  terminate  by  showing  that  the  least  fixed  point  of  any  functional  in  the 
abstract  escape  semantic  domain  can  be  computed  in  a  finite  munber  of  steps.  That  is,  for 
all  functions  defined  according  to  the  above  equation,  there  must  exist  some  j  such  that 

for  all  k  >  j.  A  way  of  showing  that  there  exists  such  a  j  is  to  show  that  every  functional  F 
must  be  monotonic  and  that  the  fixpoint  iteration  is  performed  over  a  finite  domain.  First, 
every  functional  over  escape  pairs  defined  in  the  abstract  escape  semantics  is  composed  of 
monotonic  operators  and  the  least  upper  bound  operator  U,  which  is  monotonic.  Thus, 
every  functional  in  the  abstract  escape  semantics  is  monotonic.  Second,  D^^  is  finite  for 
each  base  type  b.  Z)^'^''^  is  also  finite  whenever  i)p  and  £)^^  are  finite,  each  domain  D^ 
for  each  type  r  is  finite.  By  induction,  then,  in  a  strongly  typed  system  where  all  types  are 
finite,  all  V^  are  finite.  When  finding  the  least  fixpoint  of  a  function  of  type  r,  we  need 
only  search  over  the  subdomain  D'^^  of  Do  and  D'^  is  finite.    Thus  the  least   fixpoint   can 
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be  computed  in  a  finite  number  of  steps.  Hence  any  analysis  based  on  the  abstract  escape 
semantics  is  guaranteed  to  terminate  at  compile-time.  □ 

For  example,  consider  the  foUowing  function  f  of  type  int  —*  int  — >  int  defined  by 

f   X   y   =   if    (x=0)    then  y   else   f    (x-l)    (x+y) 

The  corresponding  function  /  under  the  abstract  escape  semantics  is  described  by 

/     =     (0,Ax.(i(i),  Ai/.6e[if    (x=0)   then  y  else  f    (x-l)    (x+y)|[x  h^  a;,y  i-^  j/])) 
=     (0,  Ax.(x(i),  Xy.y  U  (/(2)(0,  er-r))(2)(0,  erv))). 

Since  /  is  recursive,  /  is  the  least  flxpoint  of  the  functional  F  of  type  {int  —>  int  — >  int) 
—^  int  -^  int  — >  int  defined  by 

F  =  A/.(0,Aa:.(z(i),A2/.j/U  (/(2)(0,err))(2)(0,er7-})). 

Then,  the  least  flxpoint  is  foimd  by  the  following  fixpoint  iteration: 

=  (0,  Aa;.(x(i),  Xy.y  U  (±,„t^,nt^,„((2)(0,  err))(2)(0,  err))) 

=  (0,  Aa;.(a;(i),  Xy.y  U  -Lint-mt(2)(0,  err))) 

=  (0,A2:.(i(i),  Ay.yU  ±,„()) 

=  {0,Az.(a;(i),  Ay.y)) 

fW     =  F(/(°)) 

=  (0,  Ai.(a;(i),  Xy.y  U  (((0,  Ai.(x(i),  Ay.y)))(2)(0,  err))(2)(0,  err))) 

=  (0,Ax.(x(i),A7/.j/U(((0,A2/.T/))(2)(0,  err))) 

=  (0,Aa;.(a;(i),  Ay.T/U  (0,err) 

=  {0,Xx.{x^^),Xy.y)) 

Since  /'°^  =  f^^\  a  fixpoint  has  been  found.  Thus,  /  =  {0-,Xx.{xii\,  Xy.y)). 

2.4      Escapement  Testing 

Since  interpretation  under  the  abstract  escape  semantics  is  guaranteed  to  terminate,  the 
abstract  escape  semantics  can  be  used  as  a  basis  to  infer  the  escape  information  for  functions 
in  a  program  at  compile-time.  We  describe  escape  testing  algorithms  including  a  global 
escape  test  and  a  local  escape  test,  in  which  the  abstract  functions  are  used  to  detect  static 
information  about  the  escape  properties  of  the  corresponding  functions  in  a  program. 


We  perform  the  escape  test  on  each  argument  of  a  function  call  separately.  Thus,  at 
any  time  we  are  only  interested  in  whether  or  not  a  particular  single  object  escapes.  Other 
objects  may  escape  in  the  result  of  a  function  call,  but  are  ignored  by  our  analysis.  If  a 
function  has  n  parameters,  then  escape  test  will  be  performed  n  times,  each  time  treating 
a  different  parameter  as  interesting. 

Global  Escape  Test 

We  describe  a  global  escape  test  which  provides  the  global  escape  information  about  each 
function  in  a  program  that  holds  true  for  every  possible  application  of  the  function.  The 
global  escape  test  is  performed  only  on  a  function  definition,  and  thus  gives  general  infor- 
mation about  the  escape  property  of  that  function.  To  do  so,  we  have  to  apply  the  escape 
semantic  value  of  a  function  to  arguments  that  cause  the  greatest  escapement  possible. 

Definition  2.3  (Worst-case  Escape  Function)  For  each  non-list  type  r,  we  define  the 
abstract  function  W^  that  corresponds  to  a  function  from  which  every  argument  escapes. 

{m 
Axi.(a;i(i),Ax2-(a;i(i)Ui2(i),---,^a;„.([Ja:i(i),err)...))     m  >  1 
p=i 
err  tti  =  0 

where  m  is  the  number  of  arguments  that  a  function  of  type  r  can  take  before  returning  a 
primitive  value.  For  each  list  type  of  r  list,  W^ '"'  is  defined  to  be  W^. 

Given  a  function  f  Xi  X2  ■  ■  ■  x^  =  bodyf  of  arity  n,  the  position  i  of  an  interesting 
parameter,  and  an  abstract  escape  semantic  environment  efiVo  mapping  /  to  an  element  of 
Do,  the  global  escape  test  function  G_escape?  determines  whether  the  z""  parameter  of  / 
could  possibly  escape  /  or  not.  It  is  defined  as  follows: 

G_escape?{/,  z,  eni'^)  =  (O^lf  xi   ...  2„I  envo[x,  >->  y,])(i) 
where 

y,  =  {l,W'^'),  /*  The  z"*  parameter  is  an  interesting  object  */ 
for  all  j  <  n  and  j  /  i, 

yj  —  (0,  W'^'),  I*  Other  parameters  are  not  interesting  objects  */ 

and  T,  is  the  type  of  the  z'"*  parameter  of  /.  Only  the  z'"'  argument  to  /  is  an  interesting 
object  and  other  arguments  are  not  interesting  objects.  The  functional  part  of  each  argu- 
ment causes  maximal  escapement.  Thus,  from  the  result  of  the  global  escape  test  function, 
we  can  conclude  the  following: 
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•  K  G _esca pe?  (/,  i,  enuo)  =  0  then  we  conclude  that  in  any  possible  application  of  /  to 
n  arguments,  the  i"*  argument  does  not  escape  /. 

•  If  G_escape?(/,  i,  efiVo)  =  1  then  it  means  that  in  some  possible  application  of  /  to  n 
arguments,  the  i"'  argimient  could  escape  /. 

Local  Escape  Test 

Generally,  we  would  like  to  know  if  an  argument  escapes  from  a  particular  call  to  a  function. 
This  depends  on  the  values  of  the  argimients  of  that  call.  We  describe  a  local  escape  analysis 
which  provides  escape  information  of  a  fimction  in  a  particular  context.  The  local  escape 
test  determines  the  escape  behavior  of  a  particular  function  call,  and  thus  yields  more 
specific  results  than  the  global  escape  test.  Given  a  function  f  xi  X2  .  ■  ■  Xn  =  bodyj  of 
arity  n  in  an  application  /  ei  ...  €„,  the  position  i  of  an  interesting  parameter,  and  an 
abstract  escape  semantic  envirormient  efiVg  mapping  /  and  the  free  identifiers  within  Ci 
through  e„  to  elements  of  Do,  the  local  escape  test  function  L.escape?  determines  whether 
the  i^^  parameter  of  /  could  escape  /  during  the  evaluation  of  /  ej  ...  e„.  It  is  defined  as 
follows: 

L_escape?(/,i,  ei,...,e„,eni;o)  =  (Oel/ a;i  •••  ^nj  enVo[x,  ^-^  y^])(^i) 
where 

3/i  =  (l,(Oe|cil  e"^'o)(2)))  /*  The  2*'*  parameter  is  an  interesting  object  */ 
and  for  all  j  <  n  and  j  /  i, 

j/j  =  (O,(0e[ejl  eiiVo)i2))-  I*  Other  pareimeters  are  not  interesting  objects  */ 

Only  the  i""  parameter  is  an  interesting  object  and  other  parameters  are  not  interesting 
objects.  The  functional  part  of  each  argimient  is  the  functional  behavior  of  each  expression 
Ci.  Then,  from  the  result  of  the  local  escape  test  function,  we  can  conclude  the  following: 

•  If  L_escape?(/,  i,  Cj, . . .,  e„,  envo)  =  0  then  we  conclude  that  the  z""  argument  does  not 
escape  /  in  the  particular  application  of  /  to  ei  through  e„. 

•  If  L_escape?(/,  i,  Ci, . . .,  CnjCnUo)  =  1  then  the  i""  argument  couZd  escape  /  in  the 
particular  application  of  /  to  e\  through  e„. 
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Examples 

As  an  example,  consider  a  program  defined  as  follows: 
letrec      g   a  b  =    if    (a   <   b)    then  0   else   a; 

h   c   d  =    if    (c    <   d)    then  d   else   0; 

map  f  1  =  if  (null  1)  then  nil 

else  cons  (f  (car  1))  (map  f  (cdr  1)); 

in   ...  (map  (g  3)  [1,3,5])  ...  (map  (h  3)  [1,3,5])  ... 

We  assume  that  the  type  of  each  function  is  given  by 

g  :  int  -^  int  —>  int 
h  :  int  — *  int  — >  int 
map  :  [int  — ►  int)  —*  int  list  — >  int  list. 

Then,  the  abstractions  g,  h,  and  map  of  g,  h,  and  map  under  the  abstract  escape  semantics 
are  defined  as  follows: 

g  =     (0,Aa.(a(i),A6.((0,er7-)Ua))) 

=     (0,  Aa.(a(i),  A6.a)) 
h  =     (0,Ac.{c(i),Ad.((0,er7-)Ud))) 

=     (0,Ac.(c(i),Ad.d)) 
map     =     (0,A/.(/(i),A/. 

(0,err)U(//)U((map(2)/)(2)/) 

Since  map  is  defined  recursively,  the  meaning  of  Tnapis  found  by  fixpoint  iteration  as  follows: 

map^^^l  f  I     =     {0,err) 

map(')fl     =     (0,err}u(/(2)/)U((mapj;j/)(2)0 
=     (0,  err)  U  (/(2)  /)U(0,  err) 

mapi'^fl     =     (0,err)U(/(2)/)U((map{^j/)(2)/) 
=     (0,err>U(/(2)/)u(/(2)/) 

Since  map^^^  =  m.ap^'^\  we  have  that  map  =  (0,  A/.(/(i),  A/./(2)  /)).  Let  eiiVo  be  an  abstract 
escape  environment  defined  as  ehvo  —  (g  '-^  ff,h  i-^  /i,map  i-^  map]. 
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Global  Escape  Information 

To  find  the  global  (i.e.  worst-case)  escape  property  of  map,  we  apply  the  global  escape  test 
fvinction  G.escape?. 

G -escape? (map,  1,  envo)  =  (Oefniap  f   l]eni;'o)(i)  =  0 

where 

env'o  =  ehvo{t  ^  (1,  iy'"'^'"')>  1  ^  (0,  W'"""')], 
^ir.t-.int  ^  Aa;.(a;(i),err),  l^'"""'  =  err. 

Thus,  we  can  conclude  that  the  first  parameter  f  of  the  function  map  can  never  escape  map 
globally.  And, 

G-escape?(map,  2,  envo)  =  (Oe[map  f   l|enf'o)(i)  =  1 

where 

env'o  =  e-nvo{t  ^  (0,  VF'"*^'"'),  1  k^  (1,1^'"""')], 
^int^int  ^  Aa;.(a;(i),  err),  W'"""'  =  err. 

This  means  that  the  second  parameter  1  of  the  function  map  could  escape  in  some  situation. 
Thus,  we  cannot  say  that  1  never  escape  map  globally. 

Local  Escape  Information 

To  determine  the  local  escape  property  of  map  in  a  particular  context,  we  apply  the  local 
escape  test  function  L.escape?. 

L.escape?(map,  2,(g  3),  [l,  3,  5],  env,,)  =  (Ojmap   f    l}env'o)c[)  =  0 

where 

env'o  =  enVo[f  ^-^  (0,  (5(2)(0,  err))(2)),  1  >-*  (1,  err)]. 

Thus,  we  can  conclude  that  the  second  parameter  1  of  the  function  map  does  not  escape 
locally  in  (map   (g  3)    [1,3,5]). 

L.escape? (map,  2,  (h  3),  [l,  3,  5],  ent^o)  =  (Oe[niap  f   l|eni;'o)(i)  =  1 

where 

env'o  =  ehvo[i  h-.  (0,  (/i(2)(0,  e7T))(2)),  1  >-^  (1,  err)]. 

So,  we  can  conclude  that  the  second  parameter  1  of  the  function  map  does  escape  locally  in 

(map    (h   3)    [1,3,5]). 


2.5      Improving  Precision  of  Escapement 

In  the  abstract  escape  semantics  described  in  the  previous  section,  a  list  is  treated  as  a 
single  object.  Once  an  interesting  object  is  put  in  a  list,  we  have  assume  that  the  object 
remains  in  the  list.  Thus,  no  matter  how  many  times  cdr  is  applied  to  the  list,  we  assimne 
that  the  interesting  object  remains.  Furthermore,  any  time  car  is  apphed  to  the  list,  we 
assume  that  the  interesting  object  might  be  contained  in  the  result. 
Consider,  for  example,  the  foUowing  functions: 

letrec   f  x  y  =  car(cons  x  (cons  y  nil)); 
g  X  y  =  cdr(cons  x  (cons  y  nil)); 
in  . . .  cons  (f  1  2)  (g  1  2)  ... 

where  f  is  of  type  int  — ►  int  — »  int  and  g  is  of  type  int  — »  int  -^  int  list.  Under  the  abstract 
escape  semantics,  the  definitions  of  values  /  and  5  of  f  and  g  are  the  same. 

=     (0,Aa:.(z(i),  Ay.xUy)) 

=     9 
From  the  escape  analysis  based  on  the  abstract  escape  semantics,  we  conclude  only  that 
both  X  and  y  could  escape  f  and  g.  In  fact,  for  the  function  f ,  only  the  first  parameter  x 
escapes  f ,  but  the  second  parameter  y  never  escapes  f .  Similarly,  only  the  second  parameter 
y  actually  escapes  g,  but  the  first  parameter  x  never  escapes  g. 

In  this  section,  we  present  a  method  for  improving  the  precision  of  escape  information 
that  is  obtainable  through  the  escape  analysis  using  the  position  information  of  interesting 
objects  in  a  Hst  structure. 

2.5.1      Positions  of  a  List 

The  information  about  where  an  interesting  object  occurs  in  a  list  will  provide  a  more 
accurate  approximation  of  escapement.  We  describe  how  to  include  information  about 
object's  position  within  a  list  in  the  escape  semantics,  in  order  to  keep  track  (approximately) 
of  what  position(first  element,  second  element,  etc.)  in  the  top  spine  of  the  list  an  object 
might  occur  first.  The  notion  of  position  in  a  list  is  shown  in  Figure  2.6. 

Definition  2.4  (Positions  of  a  List)  An  object  is  said  to  be  at  the  position  of  i  in  a  list 
L  if  some  part  of  or  all  of  the  object  only  resides  in  the  sublist  of  L  whose  root  cell  is 
specified  by  cdr'  L  for  some  i  >  0,  i.e.  In  other  word,  no  part  of  the  object  is  contained  in 
the  first  (z  —  1)  positions  of  L. 
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Figvire  2.6:  Positions  of  a  List 

Since  no  finite  bound  on  the  length  of  hsts  can  be  computed  at  compile  time,  we  impose 
a  bound  on  the  positions  in  the  list  that  we  are  willing  to  keep  track  of.  Beyond  this  boiind, 
we  assume  that  the  object  remains  in  the  list. 

2.5.2      Improved  Abstract  Escape  Semantics 

We  present  another  safe  and  computable  abstraction  of  the  exact  escape  semantics  that 
gives  escape  information  with  more  precision  than  the  abstract  escape  semantics  previously 
described. 

Improved  Abstract  Escape  Domains 

The  value  of  each  expression  in  the  improved  escape  semantic  domain  indicates  either  that 
no  part  of  an  interesting  object  is  contained  in  the  value  of  the  expression  ("non-escape"),  or 
that  some  part  of  an  interesting  object  may  be  contained  at  some  position  in  the  value  of  the 
expression  ("possible  escape  and  where").  The  improved  abstraction  of  the  exact  escape 
semantics  is  done  by  extending  the  basic  abstract  escape  domain  to  including  position 
information.  The  basic  improved  abstract  escape  domain,  Bo,  for  some  fixed  p  is  a  (p  -f-  2)- 
element  domain  of  pairs  as  shown  in  Figure  2.7.  The  ordering  on  pairs  in  Bo  is  defined  as 
follows: 

(0,O)C(l,p)C(l,p-l)C...C(l,l)C(l,O) 

The  interpretation  of  elements  of  B^  is  defined  as  follows: 
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(1,0) 


(l,p-l) 
(l,p) 

(0,0) 

Figure  2.7:  The  Improved  Abstract  Basic  Escape  Domain 

•  (1,  fc)  :  Some  part  of  or  all  of  an  interesting  object  may  be  contained  in  the  value  of 
the  expression  only  at  a  position  greater  than  or  equal  to  >  Ar.  (not  at  a  position  less 
than  k) 

•  (0,0)  :  No  part  of  any  interesting  object  is  contained  in  the  value  of  the  expression. 

The  improved  abstract  escape  domain  Do  is  an  improved  abstraction  of  Do,  and  the  im- 
proved abstract  escape  environment  Eo  is  a  domain  of  functions  mapping  identifiers  to  their 
abstract  escape  meanings.  They  are  defined  as  follows: 

Do     =     /.^o  /*  Improved  abstract  escape  semantic  domain  */ 

T 

Eo     =     Id  ^  Do     I*  Domain  of  improved  abstract  escape  environments  */ 

The  improved  abstract  escape  subdomain  Z?^  for  expression  of  type  r  is  defined  as  follows: 

Z?o"'  ~  Bo  X  {err}  improved  abstract  subdomain  for  integers 

£)bool  _  B^  X  {err}  improved  abstract  subdomain  for  booleans 

jjTi-^T2  _  ^^  X  {Dl'  — »  Do')  improved  abstract  subdomain  for  functions 

£)T  hat  _  £)T  improved  abstract  subdomain  for  lists 

Improved  Abstract  Escape  Semantic  Functions 

We  now  introduce  improved  abstract  escape  semantic  functions  as  follows: 
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Oc|cons| 


OjcarJ 
Ojcdrl 

OJnulll 


=     ((0,0),err),    cG  {..., -1,0,1, ...,true,false} 
=     ±1-  (  The  bottom  element  in  D^  ) 
=     {{0,0),Xx.{x(■^yXy.pus^x,y))) 

where 

push(a;,  y)  =  if  (2;{i)(i)  =  1)  then  ((1,  0),  S(2)  U  t/(2)) 

elseif  (2/(i)(i)  =  1)  then  ((1,  min(j/(i)(2)  +  l,p)),  a;(2)  LJ  2/(2)) 

else  ((0,0),  2(2)  U  2/(2)) 
=     ((0,0),Ax.  pick(2;)) 

where  pick(z)  =  if  (■Z(i)(2)  >  0)  then  ((0,0),  Z(2))  else  z 
=     ((0,0),Aa;.  rest(a;)) 

where    rest(2)  =  ((::(i),max(2(2)  -  1,0)),  2(2)) 
=     ((0,0),Aa;.((0,0), err) 


Figure  2.8:  Improved  Abstract  Escape  Semantic  Functions 
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Con  -^  Do  I*  Improved  semantic  fimction  for  constcints  */ 

£xp  — t  Eo  —^  Do     /*  Improved  semantic  function  for  expressions  */ 
Program  — »  Do       /*  Improved  semantic  function  for  programs  */ 

The  improved  abstract  escape  semantic  functions  are  given  in  Figure  2.8  and  Figure  2.9. 

The  improved  abstract  value  of  cons  takes  two  arguments,  and  returns  an  improved 
escape  pair  of  their  least  upper  botmd  by  updating  the  position  information  of  an  interesting 
object  in  the  result  list.  The  improved  abstract  value  of  car  returns  its  argument  according 
to  the  position  of  an  interesting  object.  The  improved  abstract  value  of  cdr  also  updates 
the  position  information  appropriately.  Note  that  the  improved  abstract  escape  semantic 
function  Oc  for  cons,  car  and  cdr  provides  more  precise  escape  information  than  the 
abstract  escape  semantic  function  Oc-  ehvo  is  an  improved  abstract  escape  environment  in 
Eo,  and  nullenVo  is  an  improved  abstract  escape  environment  that  maps  every  identifier  on 
to  the  least  element  of  its  improved  abstract  escape  semantic  domain. 


Safety  and  Termination 

To  show  that  the  improved  abstract  escape  semantics  will  never  produce  wrong  escape 
information  with  respect  to  the  exact  escape  semantics,  we  introduce  a  notion  of  safety  with 
respect  to  exact  escape  information  that  relates  the  improved  abstract  escape  semantics  with 
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delxjehvo  =     enuolz] 

Oei^i  +  e2JehVo     —     ((0,0),  err)  /*  same  for  e\  -  e-i  and  ei  =  t^  */ 
delif  ei  then  62  else  ealeni;^     =     (Oe|e2lenj;o)  U  (Oelealen?;,,) 
Oeleiezlenvo  =     (Oe|eileni;o)(2)  {d^\e2\ehvo) 

OeIlambda(i).eJenUo     =     (F,  Aj/.Oe[elenVo[i  i-*  y]) 

where 

y  =  (0,0)U(|J(ent;<,[2l)(:))and 

F  =  Set  of  cill  free  identifiers  in  (lainbda(2;).e). 
delletrec  xi  =  ei;..  .;x„  =  e„;ine|enUo     =     Oelejenv'^ 

where  env'^  -  envo\xx  ^  Oeleilenv^, . .  .,x„  ^  6^\e^env'^ 

Figure  2.9:  Improved  Abstract  Escape  Semantic  Fimctions 

the  exact  escape  semantics.  Let  u  and  v  be  values  of  an  expression  e  of  type  r  or  t  list  in 
the  improved  abstract  escape  domain  Do  and  the  exact  escape  domain  /?„,  respectively.  Let 
n  be  the  number  of  arguments  that  the  type  t  can  take  before  returning  a  veilue  of  primitive 
type.  We  say  that  the  improved  abstract  escape  semantic  value  u  is  a  saje  approximation 
(with  respect  to  exact  escape  information)  for  the  exact  escape  semantic  value  v  iff 

(  U  P(l))  E   (NAPfc(u,5i,...,5fc))(i)(i) 

pin  NAPi(i',t,  ,,-,,et) 

and 

(M/AfpinNAP^(v,t, tO&P(i)  =  lP°^**'°"°fp)  -   (NAP;t(u,5i,...,5fc))(i)(2) 

for  all  k  <  n  where  5,  is  a  safe  approximation  for  t,  for  all  2  <  k. 

Theorem  2.3  (Safety)  For  any  expression  e,  and  environments  eni'o  and  efivo  such  that 
for  all  y,  envoly]  ts  safe  for  envdy},  Oele}efiVo  ts  safe  (with  respect  to  escape  information) 
for  Oelejenvo- 

Proof  :  We  can  prove  by  structural  induction  on  expression  e. 
I.  Base  Case: 
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1.  e  =  c:  Oelcjehvo  =  0^4  and  Oeicjenvo  =  OcM-  For  c  G  {. . .  ,-1 ,0, 1 ,. .  .true, 
false,  nil,  null  }  ,  Odcj  =  Ode}  and  thus  it  clearly  holds.  For  c  =  cons,  it  holds 
because,  if  Xi  and  X2  are  safe  for  j/i  and  t/2i  respectively,  push(x,  y)  is  also  safe  for  a  list 
consisting  of  j/i  and  2/2-  It  holds  for  c  =  car,  cdr,  because  if  x  is  safe  for  y  then  pick(x)  is 
safe  for    first(2/)  and    rest(z)  is  safe  for    second(j/). 

2.  e  =  x:  del^jenVo  =  envolxj  and  OelxjenVo  =  enUola;].  Since  for  all  y  ehvolyj  is  safe 
for  envolyl,  it  clearly  holds. 

(II)  Structural  Induction  Step:  Assume  that  Oe|e|enVo  is  safe  for  Oe|[e]eut;o  for  expressions 
such  as  eo,  Ci ,  62,  £3  cind  €„.  (structural  induction  hypothesis)  Then,  we  show  that  OeleleTit;^ 
is  safe  for  Oelele^iUo  for  e  =  Ci  +  62,  if  Ci  then  62  else  63,  6162,  lambda(a;).e,  and 
letrec  zi  =  ei;...;2„  =  e„;  in  cq-  This  can  be  proved  in  an  exactly  sinular  way  to  the 
proof  of  safety  of  the  abstract  escape  semantics.  □ 

The  effectiveness  of  interpretation  under  the  improved  abstract  escape  semantics  means 
that  it  terminates  on  every  valid  program  at  compile-time. 

Theorem  2.4  (Termination)  For  any  (finite)  program  pr  G  Program,  Opr\pr\  are  com- 
putable, i.e.  always  terminates  in  finite  number  of  steps. 

Proof  :  Every  functional  in  the  improved  escape  domain  that  is  defined  through  the 
abstract  improved  escape  semantic  functions  is  composed  of  the  operators  such  as  the  least 
upper  boimd  operator  U,  push,  pick,  and  rest,  pick  and  rest  are  monotonic  operators.  Since 
the  composition  of  monotonic  functions  is  also  monotonic,  every  functional  is  monotonic. 
Furthermore,  each  subdomain  D"^  is  finite.  □ 

Precision  Improvement 

The  precision  improvement  of  the  improved  abstract  escape  semantics  over  the  abstract 
escape  semantics  means  that  the  escape  information  obtained  by  the  improved  abstract 
escape  semamtics  always  implies  that  obtained  by  the  abstract  escape  semantics,  but  not 
always  vice-versa. 

Theorem  2.5  (Precision  Improvement)  The  abstract  escape  semantics  is  equivalent  in 
its  information  content  to  the  improved  abstract  escape  semantics  with  p  =  0.  Thus,  the  im- 
proved abstract  escape  semantics  with  some  p  >  0  provides  more  precise  escape  information 
than  the  abstract  escape  semantics. 

Proof  :  We  introduce  the  notion  of  equivalence  with  respect  to  escapement  information 
content  which  relates  the  abstract  escape  semantics  to  the  improved  abstract  escajie  seman- 
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tics  with  p  =  0.  Let  u  and  v  be  values  of  an  expression  e  of  type  r  in  Do  and  Do  withp  =  0, 
respectively.  Let  n  be  the  number  of  arguments  that  the  type  t  can  take  before  returning 
a  value  of  primitive  type.  We  say  that  u  is  equivalent  (with  respect  to  escape  information) 
to  V  iff 

for  all  fc  <  n  where  5,  is  equivalent  to  <,  for  all  i  <  k.  Then,  for  all  expression  e  and 
environments  envo  and  envo  with  p  =  0  such  that  for  all  y,  enVolyl  i^  semantically  equivalent 
(with  respect  to  escape  information)  to  envoly]  with  p  =  0,  we  have  that  Oelejenfo  is 
semcintically  equivalent  to  Oe|e]eni»o  with  p  =  0.  This  can  be  proved  by  structural  and 
fixpoint  inductions. 

We  introduce  the  notion  of  improvement  with  respect  to  escapement  information  content 
which  relates  the  improved  abstract  escape  semantics  with  p  >  0  to  the  improved  abstract 
escape  semantics  with  p  =  0.  Let  u  and  v  be  values  of  an  expression  e  of  type  r  in  Do  with 
p  >  0  and  Do  with  p  =  0,  respectively.  Let  n  be  the  number  of  arguments  that  the  type  r 
can  take  before  returning  a  value  of  primitive  type.  We  say  that  u  is  improved  (with  respect 
to  escape  information)  over  v  iff 

(NAPfc(u,5i,...,50){i)(i)  E  (NAPfc(t;,ii,...,ifc))(i)(i) 

and 

(NAPi(u,  5a, . . .,  h))(i)(2)  E  (NAPfc(t>,/i, . . . ,  ^t))(i)(2)  =  0 

for  all  k  <  n  where  s,  is  improved  over  i,  for  all  i  <  k.  Then,  for  all  expression  e  and 
environments  envo  with  p  >  0  and  ehvo  with  p  =  0  such  that  for  all  y,  envoly}  with  p  >  0 
is  improved  over  eni'dyj  with  p  =  0,  we  have  that  eni;o|j/J  with  p  >  0  is  improved  over 
Oe|ejeni)o  with  p  =  0.  This  can  be  proved  by  structural  and  fixpoint  inductions.  □ 
The  relationship  among  the  standard  semantics  (SS),  the  non-standard  exact  escape  seman- 
tics (ES),  the  abstract  escape  semantics  (AES)  and  the  improved  abstract  escape  semantics 
(lAES)  is  shown  in  Figure  2.10. 

2.5.3      Improved  Escapement  Testing 

We  describe  global  and  local  escape  testing  algorithms  based  on  the  improved  abstract 
escape  semantics. 
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Figure  2.10:  Relationship  among  Standard  and  Escape  semantics 

Improved  Global  Escape  Test 

Given  a  function  f  xi  X2  ■  ■  ■  x^  =  hodyj  of  arity  n,  the  position  i  of  an  interesting 
pcirameter,  and  an  improved  abstract  escape  semantic  environment  efiVo  mapping  /  to 
an  element  of  £>„,  the  improved  global  escape  test  function  G-iescape?  which  determines 
whether  the  z'"'  parameter  of  /  could  possibly  escape  /  in  any  application  of  /  or  not  is 
defined  as  follows: 

Gjescape?(/,  2,  ent^o)  ==  (OJ/ ij   ...  x^]  ehVo[x^  ^  yi\)(\){\) 
where 

J/,  =  ((1,  0),  H^'^'),  /*  The  i*-^  parameter  is  an  interesting  object  */ 
and  for  all  j  <  n  and  j  -^  i, 

yj  =  ({0,  0),  ly^^),  /*  Other  parameters  are  not  interesting  objects  */ 

and  T,  is  the  type  of  the  i""  parameter  of  /.  Only  the  i'^  argument  to  /  is  an  interesting 
object  and  other  arguments  are  not  interesting  objects.  Since  the  whole  z"'  argument  is 
interesting,  its  position  value  is  set  0.  The  result  of  the  global  improved  escape  test  function 
is  interpreted  as  follows: 

•  If  G_iescape?(/,  z,  CTiUo)  =  0  then  we  conclude  that  the  z'"*  argimient  does  not  escape 
/  in  any  possible  application  of  /  to  n  arguments. 

•  If  G-iescape?(/,  z,  efii'o)  =  1  then  we  cannot  say  that  the  z      argument  does  not  escape 
/  in  any  possible  a])i)lication  of  /  to  n  arguments. 
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Improved  Local  Escape  Test 

Given  a  function  f  x\  X2  •  •  •  Zn  =  bodyj  of  arity  n  in  an  application  context  /  Ci  ...  e„, 
the  position  i  of  an  interesting  parameter,  and  an  improved  abstract  escape  semantic  envi- 
ronment ehvo  mapping  /  and  the  free  identifiers  w^ithin  Cj  through  €„  to  elements  of  £>o,  the 
improved  local  escape  test  function  LJescape?  which  determines  whether  the  i"'  parameter 
of  /  could  escape  /  locally  in  the  evaluation  of  /  Cj  . . .  €„  is  defined  as  follows: 

L_iescape?(/,  z,  ei,...,e„,ent;o)  =  {0^1/  Xi   ...  a;„I  enVo{x,  \->  yi])(i)(i) 
where 

yi  =  ((1,0),  (Oele,]  enVo)(2))  /*  The  i"'  parameter  is  an  interesting  object  */ 
and  for  a]l  j  <  n  and  j  /  i, 

yj  =  ((0,  0),  (Oe|ej]  enVo)(^2))-  I*  Other  parameters  are  not  interesting  objects  */ 
The  result  of  the  local  improved  escape  test  function  is  interpreted  as  follows: 

•  If  Ljescape?(/,  i,  ei, . . .,  e„,  eni^o)  =  0  then  we  conclude  that  the  i""  argvunent  does 
not  escape  /  in  the  particular  application  of  /  to  ej  through  e^. 

•  If  L_iescape?(/,  i,  ej, . . . ,  e^,  efiVo)  =  1  then  we  cannot  say  that  the  f""  argimient  does 
not  escape  /  in  the  particular  application  of  /  to  e-[  through  e„. 

Examples 

As  an  example,  consider  the  functions  given  before: 

letrec 

f  X  y  =  car(cons  x  (cons  y  nil)); 

g  X  y  =  cdr(cons  x  (cons  y  nil)); 
in  .  .  . 

where  f  is  of  type  int  -^  int  — >  int  and  g  is  of  type  int  — >  int  — >  int  list.  Under  the  improved 
abstract  escape  semantics,  the  definitions  of  the  values  /  and  g  of  f  and  g  are  expressed  as 
follows: 

/     =     ((0,0),Aa-.(2;(i),Aj/.pick(push(z,push(j/,((0,0),err)))))) 
g     =     ((0,O),Aj-.(y(i),Aj/.rest(push(i,push(y,((0,O>,err)))))) 

Let  eiiVo  be  defined  as  eiiVg  =  [f  >—>  f,g  >-^  g] 
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Gjescape?(f,2,ent;o)  =  (Oelf   x  ylent;'o)(i)(i)  =  0 

where  env'o  =  enVo[x.  i->  ((0, 0),  err),y  i->  ((1, 0),  err)].  Thus,  we  can  conclude  that  the 
second  parameter  y  of  f  does  not  escape  t  globally.  Similarly, 

Gjescape?(g,l,envo)  =  (Oe[g  x  y\env' o)(i){i)  =  0 

where  env'o  =  envj\r.  h^  ((1,  0),  err),y  i-»  ((0,  0),  err)].  Thus,  we  can  conclude  that  the  first 
parameter  x  of  g  does  not  escape  g  globally. 

2.6      Complexity  of  Escape  Analysis 

The  abstract  interpretation  framework  for  the  escape  analysis  that  deals  with  higher-order 
functional  languages  with  lists  is  very  similar  to  the  framework  for  strictness  analysis  for 
higher-order  functional  languages  without  non-flat  domains  (lists).  Both  analyses  use  a 
two-element  domain  as  their  basic  abstract  domains,  respectively.  Thus,  the  order  of  time 
complexity  of  escape  analysis  is  the  same  as  that  of  strictness  analysis  for  higher-order 
languages  with  non-flat  domains,  which  is  exponential  in  the  number  of  arguments  to  the 
function  being  analyzed  in  case  of  non-higher-order  functions.  In  case  of  a  higher-order 
function,  the  complexity  is  much  worse  than  exponential  in  the  number  of  arguments  to 
the  fvmction  being  analyzed,  and  depends  on  the  types  of  its  arguments.  However,  the 
improved  escape  analysis  uses  a  (p  -(-  2)-element  domain  as  its  basic  abstract  domain.  So, 
the  order  of  time  complexity  of  improved  escape  analysis  is  higher  than,  but  comparable  to, 
that  of  strictness  analysis  for  higher-order  languages  with  non-flat  domains.  The  abstract 
interpretation  framework  for  strictness  analysis  for  higher-order  functional  languages  with 
flat  domains  uses  a  A;-eleinent  domain  as  its  abstract  domain  where  k  is  fixed  but  greater 
than  2.  Thus,  when  compared  with  the  complexity  of  strictness  analysis  for  higher-order 
functional  languages  with  non-flat  domains,  the  complexity  of  escape  analysis  is  less,  and 
the  complexity  of  improved  escape  analysis  is  similar  to  that. 

Fortunately,  as  is  true  for  many  analyses,  worst-case  situations  rarely  occur  in  practice 
and  the  number  of  iterations  required  is  typically  small.  Furthermore,  the  average  number 
of  arguments  to  functions  does  not  grow  with  the  size  of  a  program,  and  thus  if  an  arbitrary 
bound  is  placed  on  the  number  of  arguments,  then  the  analysis  based  on  the  abstract  escape 
semantics  can  be  shown  to  be  linear  in  program  size. 


Chapter  3 


Refinements  of  Escape  Analysis 


The  escape  analysis  described  in  the  previous  chapter  is  concerned  with  the  escapement 
properties  of  arguments  and  local  objects  of  a  function.  These  objects  are  treated  as  a  whole 
with  respect  to  the  activation  of  the  function  call.  That  is,  even  when  only  some  part  of 
such  an  object  escapes,  the  escape  analysis  indicates  only  that  the  object  escapes.  Thus,  for 
structured  objects  such  as  lists  and  trees,  the  escape  information  that  is  obtainable  through 
the  escape  analysis  is  rather  coarse  because  it  does  not  specify  the  escaping  substructure 
even  when  ordy  some  part  of  a  structured  object  escapes.  Such  refined  escape  information, 
if  inferred  at  compile-time,  can  be  useful  for  more  efficient  management  of  storage  for 
structured  objects. 

In  this  chapter,  we  present  a  method  for  computing  more  refined  escape  information 
for  a  higher-order,  monomorphic,  strict  functional  language.  This  method  is  based  on  a 
compile-time  semantic  analysis  called  refined  escape  analysis  which  is  an  extension  of  the 
escape  analysis  and  indicates  at  compile-time  how  much  of  an  object  such  as  argument  or 
local  object  of  a  function  outlives  the  activation  of  the  function  call.  First,  we  introduce 
a  non-standard  denotational  semantics  called  refined  escape  semantics  that  describes  the 
actual  refined  escape  behavior,  but  is  incomputable  at  compile-time.  A  safe  and  computable 
abstraction  of  the  exact  refined  escape  semantics  is  then  presented.  Based  on  the  abstract 
refined  escape  semantics,  we  describe  the  escape  testing  algorithms  which  determine  refined 
escape  information.  Another  safe  and  computable  abstraction  of  the  exact  escape  semantics, 
called  improved  abstract  refined  escape  semantics,  that  improves  the  precision  of  refined 
escape  information  is  also  presented  using  the  position  information  of  objects  in  a  list 
structure.  Finally,  the  relationship  between  escape  analysis  and  refined  escape  analysis 
with  respect  to  their  information  content  is  discussed. 
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3.1      Refined  Escapement  of  Objects 

The  escape  model  described  in  the  previous  chapter  is  concerned  with  the  escapement  of 
arguments  each  of  which  is  treated  as  a  whole  object.  Thus,  for  structured  data  objects 
such  as  lists,  the  escape  information  that  can  be  obtainable  through  the  escape  analysis  is 
rather  weak.  Consider,  for  example,  the  append  function  defined  as  follows: 

letrec     append  x  y  =   if    (null  x)   then  y 

else    cons    (car  x)    (append    (cdr  x)    y) ; 
in    . . .    append    [1,2.3]     [4,5,6]     ... 

We  assume  that  append  is  typed  as  int  list  -^  int  list  — >  int  list.  From  the  escape  analysis 
described  in  the  previous  chapter,  we  can  only  conclude  that  both  the  first  and  the  second 
parameters  of  append  could  escape  as  follows:  The  definition  of  the  escape  semantic  value 
append  of  append  (shown  uncurried  for  convenience)  is: 

append  x  y   =   y  U  [x  \J  append  x  y) 
The  meaning  of  append  is  found  by  fixpoint  iteration  as  follows:. 

append  =  (0,  \x.{xii\,  Xy.x  U  y)). 
Let  envo  be  defined  as  eriVo  =  [append  h^  append]  Then, 

G.escape?(append,  IjCnVo)     =     (Oe|append  x   Ylenv'o)(i) 

=     (((0,err)u(((l,err)))(i)=l 

where  env'o  =  eni'<,[x  >—>  (1,  err),  y  i— >  (0,err)].  And, 

G.escape?(append,  2,  ent;o)     =     (Oe|append  x   yjenv'o){i) 

=     ((0,e7-r)u((l,err)))(i)=  1 

where  env'o  —  enVo[x  ^-»  (0,  err),  y  h^  (l,err)].  Thus,  we  conclude  that  append  returns  its 
first  and  second  arguments  x  and  y.  In  fact,  however,  only  some  portion  of  the  second 
parameter  y  of  the  function  append  actually  escapes,  but  some  portion  does  not  escape. 

In  this  chapter  we  will  describe  a  method  for  inferring  more  precise  escape  information 
for  structured  objects  such  as  lists.  We  first  define  the  notion  of  partial  escapement  which 
specifies  more  a  refined  notion  of  escapement  of  objects  as  shown  in  Figure  3.1. 

Definition  3.1  (Global/Local  Refined  Escapement)  Given  a  function  /  with  n  for- 
mal parameters  and  m  locally  defined  objects,  the  z"'  formal  parameter  or  local  object  is 
said  to 
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Figvu-e  3.1:  Refined  Escapement  of  Objects 

•  partially- escape  the  function  caU  to  /  globally  if,  in  some  possible  application  of  /  to 
n  argiiments,  some  part  of  the  corresponding  actual  argument  or  local  object  outlives 
the  activation  of  the  function  call,  but  the  rest  of  the  corresponding  actual  argument 
or  local  object  does  not  outlive  the  activation  of  the  function  call. 

•  partially- escape  the  function  call  to  /  locally  in  (/  Ci  . .  .e^)  if,  in  the  particular  func- 
tion application  of  (/  Cj  . .  .€„),  some  part  of  the  corresponding  actual  argument  or 
local  object  outlives  the  activation  of  the  function  call,  but  the  rest  of  the  correspond- 
ing actual  argument  or  local  object  does  not  outlive  the  activation  of  the  function 
call. 

When  all  of  an  object  outlives  a  function  call  globally  (or  locally),  we  say  that  the  object 
totally-escapes  the  function  call  globally  (or  locally). 

We  will  develop  a  method  for  higher-order,  monomorphic,  strict  functional  languages  to 
answer  the  following  questions  at  compile-time: 

•  Given  a  function,  which  parameter  or  local  object  defined  inside  the  function  escapes 
the  function  call  globally  and  to  what  extent  (i.e.  how  much  of  the  object  escapes)? 

•  Given  a  function  in  a  particular  application  context,  which  parameter  or  local  object 
defined  inside  the  function  escapes  that  particular  function  call  and  to  what  extent? 
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Figure  3.2:  Spines  of  a  List 

3.2      Refined  Escape  Analysis 

3.2.1      Spines  of  a  List 

In  a  refined  escape  model,  we  divide  objects  into  their  subcomponents  and  we  are  concerned 
with  how  much  of  an  object,  such  as  a  parameter  or  local  object,  escapes  the  function. 
We  describe  a  way  of  partitioning  list  objects  into  subcomponents  based  on  the  notion  of 
spines  of  a  list  as  is  shown  in  Figure  3.2. 

Definition  3.2  (Spines  of  a  List)  Given  a  list  L  and  some  i  >  1,  the  top  i"*  spine  of  L 
is  defined  as  the  set  of  cons  cells  accessible  by  a  sequence  of  operations  consisting  of  car 
and  cdr  where  the  number  of  occurrences  of  car  is  [i  -  1).  Similarly,  given  a  list  L  with  d 
spines  and  some  J  >  1,  the  bottom  j"*  spine  of  L  is  defined  as  the  top  {d  -  j  +  I)  spine  of  L. 

We  have  chosen  to  analyze  the  escape  properties  of  lists  in  terms  of  their  spines  for  two 
reasons: 

•  It  is  an  approximation  to  the  run-time  behavior  that  allows  a  compile-time  analysis. 

•  It  reflects  the  programming  style  commonly  used  for  strongly  typed  languages,  such  as 
ML,  in  which  lists  are  homogeneous  (all  elements  have  the  same  type)  and  functions 
(such  as  append,  map,  etc.)  often  operate  over  complete  spines  of  lists. 

The  first  point  reflects  our  inability  to  determine  precisely,  without  actually  running  the 
program,  which  individual  cells  of  a  list  might  escape.  To  form  a  terminating  compile-time 
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escape  analysis,  one  must  choose  an  approximation  of  program  behavior.  The  second  point 
reflects  our  belief  that  the  spines  are  a  good  choice  of  approximation,  since  the  cells  of  each 
spine  of  a  list  tend  to  be  treated  identically.  Many  functions,  such  as  append,  reduce,  map, 
length,  etc.,  operate  on  all  cells  of  a  spine.  Many  other  functions  have  the  form: 

f  1  =  if  predicate(car  1)  then  . . .  else  f  (cdr  1) 

or 

g  1  X  =  if  x=n  then  . . .  else  g  (cdr  1)  (arith-op  x) 

In  general,  it  is  impossible  to  determine  at  compile  time  when  the  recursion  will  bottom 
out.  One  simply  has  to  assimie  that  all  cells  in  the  spine  of  the  list  L  will  be  visited. 

3.2.2      Exact  Refined  Escape  Semantics 

We  introduce  an  exact,  but  incomputable,  non-standard  denotational  semantics  caUed  re- 
fined escape  semantics,  which  exactly  describes  the  operational  notion  of  refined  escapement 
for  functions  in  a  program.  Our  refined  escape  semantics  is  also  defined  in  terms  of  a  single 
interesting  object,  because  we  consider  that  each  parameter  or  local  object  will  be  analyzed 
separately  to  determine  its  refined  escape  behavior. 

Representing  Refined  Escape  Information 

The  meaning  we  will  attach  to  the  syntax  is  the  refined  information  about  escaping  objects. 
For  each  expression,  we  want  its  corresponding  value  in  the  extended  escape  semantic 
domain  to  be  able  to  tell  us  how  much  of  an  interesting  object  is  contained  in  the  value 
of  the  expression  ("partial-escape").  Under  the  non-standard  refined  escape  semantics,  we 
represent  the  meaning  of  an  expression  as  a  pair,  called  a  refined  escape  pair, 

1.  whose  first  element  denotes  the  containment  and  the  extent  of  an  interesting  object 
in  the  value  of  the  expression,  and 

2.  whose  second  element  denotes  the  functional  behavior  of  the  expression  defined  over 
the  escape  pairs  when  the  expression  itself  is  applied  to  another  expression. 

For  a  non-list  type  expression,  the  corresponding  value  in  the  non-standard  refined  escape 
semantic  domain  Dp  has  two  components:  The  first  component  is  an  element  of  a  domain 
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(l,d) 


(1,1) 
(1,0) 
(0,0) 

Figure  3.3:  The  Basic  Refined  Escape  Domain 

called  a  basic  refined  escape  domain,  Bp,  for  some  fixed  d  is  a  (d  +  2)-element  domain  of 
pairs  as  shown  in  Figure  3.3.  The  ordering  on  pairs  in  Bp  is  defined  as  follows: 

(0,0)  E  (1,0)  C  (1,1)  E  ...  C  (l,d-  1)  C  (l,d) 

The  interpretation  of  elements  of  Bp  is  defined  as  follows: 

•  (l,i)  :  Only  the  bottom  j  spines  of  an  interesting  object  25  contained  in  the  value  of 
the  expression,  and  the  rest  of  an  interesting  object  is  not  contained.  (If  an  interesting 
object  is  not  a  list  then  j  will  always  be  0,  which  means  that  an  indivisible  interesting 
object  is  contained  in  the  value  of  the  expression.) 

•  (0,0)  :  No  part  of  any  interesting  object  is  contained  in  the  value  of  the  expression 
whose  evaluation  is  ever  terminating. 

The  second  component  is  a  function  over  Dp,  whose  meaning  is  the  functional  behavior  of 
the  expression  when  the  expression  itself  is  applied  to  another  expression.  For  expressions 
which  have  no  higher-order  behavior,  err,  which  is  a  function  that  can  never  be  applied, 
is  used.  For  a  list  type  expression,  the  value  in  the  escape  semantic  domain  is  a  list  that 
consist  of  the  values  of  its  components  in  the  refined  escape  semantic  domains. 

Refined  Escape  Semantic  Domains 

The  refined  escape  semantic  domain  Dp  and  the  domain  of  refined  escape  environments  Ep 
are  defined  as  follows: 


Dp     =     22^p  I*  R-^fin^d  escape  semantic  domain  */ 

T 

Ep     =     /<f  — >  Dp     I*  Domain  of  refined  escape  environments  */ 

The  refined  escape  domain  Dp  is  a  sum  domain  of  each  subdomain  of  each  type.  The  refined 
escape  subdomain  Dp  for  expressions  of  type  t  is  defined  as  follows: 

Dp"'  =  Bp  X  {err}  subdomain  for  integers 

j^iMol  _  ^^  ^  [err]  subdomain  for  booleans 

2)r,-T2  =  BpX  [Dl'  -*  Dl^)  subdomain  for  functions  of  type  tj  -^  tj 

Dl '"'  =  {Bp  X  {err})  +  [D],  X  D^ '"')  subdomain  for  lists  of  type  r  list 

Refined  Escape  Semantic  Functions 

The  non-standard  refined  escape  semantic  functions  are  defined  as  follows: 


Pe 
Ppr 


Con  —*  Dp  I*  Refined  escape  function  for  constants  */ 

Exp  —*  Ep  —*  Dp     I*  Refined  escape  function  for  expressions  */ 
Program  —*  Dp       /*  Refined  escape  function  for  programs  */ 

The  semantic  equations  for  the  refined  escape  semantic  functions  Pc  that  gives  non-standard 
refined  escape  meaning  to  constants,  P^  that  gives  non-standard  refined  escape  meaning 
to  expressions,  and  Pp^  that  gives  non-standard  refined  escape  meaning  to  programs,  are 
expressed  in  Figure  3.4.  Note  that  Oracle  is  also  used  to  resolve  the  exact  escape  behavior 
of  the  conditional  expression  if.  envp  is  any  exact  refined  escape  environment  in  Ep,  and 
nullenvp  is  a  refined  escape  environment  that  maps  every  identifier  to  the  least  element  of 
its  refined  escape  semantic  domain. 

3.2.3      Abstract  Refined  Escape  Semantics 

We  present  a  safe  and  computable  abstraction  of  the  exact  refined  escape  semantics  defined 
in  the  last  section  that  allows  an  approximation  of  the  exact  escape  behavior  of  functions 
to  be  found  at  compile-time. 

We  safely  approximate  the  exact  refined  escape  semantics  by  abstracting  the  refined 
escape  semantic  subdomains  for  list  type  expressions,  and  by  approximating  the  refined 
escape  semantic  functions.  For  each  expression,  its  corresponding  value  in  the  abstract  ex- 
tended escape  semantic  domain  tells  us  how  much  of  an  interesting  object  may  be  contained 
in  the  value  of  the  expression  ("maybe  partial-escape").  The  abstract  basic  refined  escape 
domain,  Bp  for  some  fixed  d  \s  &  {d  +  2)-element  domain  that  is  similar  to  the  basic  refined 
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P,lc]  =  ((0,  0),  err),  c=  {...,- 1,0,1,...,  true,  false^l"'"'} 

Fjconsl  =  ((0,0),Aa:.(2(i),AT/.  pair(a;,j/))) 

Pjcarl  =  ((0,0),As.  flxst(a;)) 

PjcdrJ  =  ((0,0),Aa;.  second(i)) 

Pjnulll  =  ((0,0),Ax.((0,0),  err)) 

Pelcjenvp  =     Pci4 

Pelxjenvp  =     envpfx] 

Pe[ei  +  e2JenVp     =     ((0,0),  err)  /*  same  for  Ci  -  62  and  ei  =  62  */ 

Pelif  £1  then  62  else  eajenup     =     if  Oracle(ei)  then  (Pe[e2lenvp)(2) 

else  (Pe|e3]eni;p) 
Peleiczjenup  =     (Pe[eilent;p)(2)  (Pele2lent;p) 

Pe |lambda(z). ejenvp     =     {V,  Xy.P^le]enVp[x  1-^  y]) 

where 

F=(0,0)U(        IJ        (envplz]\,))u{    [J    (         U         P(i))) 

p  in  (enfp[2])  denotes  that  p  is  an  refined  escape  pair  in  ent;p|2], 
pnon-h3t  _  gg(.  of  non-list  type  free  identifiers  in  (lciinbda(x).e),   and 
p'"'  =  Set  of  list  type  free  identifiers  in  (lambda(y).e). 

Pefletrec  Xi  =  ei;. .  .;2n  =  e„;in  e|erii;p     =     PefejenVp 

where  env'^  =  enVp[xi  ^  Pe[ei]enVp, . . .,  z„  i-»  Pe|e„|enVp] 
•Pprlb'"!     =      Pelprjnullenvp 

Figure  3.4:  Refined  Escape  Semantic  Functions 
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(l,d) 


(1,1) 
(1,0) 
(0,0) 


Figure  3.5:  The  Abstract  Basic  Refined  Escape  Domain 

escape  domain  Bp  as  is  shown  in  Figure  3.5.  The  ordering  is  also  defined  as  follows: 

(0,0)  C  (1,0)  C  (1,1)  C  ...  C  (l,d-  1)  C  (l,d) 

But,  the  interpretation  of  elements  of  Bp  is  defined  differently  from  the  interpretation  of 
Bp  as  follows: 

•  (l,i)  :  Only  the  bottom  <  i  spines  of  an  interesting  object  -may  be  contained  in  the 
value  of  the  expression.  (If  an  interesting  object  is  not  a  list  then  i  will  always  be  0, 
which  means  that  an  indivisible  interesting  object  Tnay  be  contained  in  the  value  of 
the  expression.) 

•  (0,0)  :  No  part  of  any  interesting  object  is  contained  in  the  value  of  the  expression. 

The  abstraction  of  the  refined  escape  semantic  subdomains  for  hst  type  expressions  is  done 
by  representing  lists  as  finite  objects,  i.e.  by  combining  the  escape  pairs  of  all  its  elements 
into  a  single  escape  pair.  The  abstract  refined  escape  semantic  domain  Dp  and  the  domain 
Ep  of  abstract  refined  escape  environments  are  defined  as  follows: 

Dp     =     ^-Dp  /*  Abstract  refined  escape  semantic  domain  */ 

T 

Ep     =     Id  —*  Dp     /*  Domain  of  abstract  refined  escape  environments  */ 
The  abstract  refined  escape  subdomain  DT^  for  expressions  of  type  r  is  defined  as  follows: 
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/)'"'  =  5p  X  {err}  abstract  subdomain  for  integers 

£)booi  _  Bp  X  {err}  abstract  subdomain  for  booleans 

£)Ti-.T2  _  Bp  X  {Dp^  — ►  Dp')     abstract  subdomain  for  functions  of  type  Ti  — »  T2 

£)T  list  _  jQT  abstract  subdomain  for  lists  of  type  r  list 

The  abstract  refined  escape  semantic  functions  are  defined  as  follows: 

Pf.       :     Con  -+  Dp  /*  Abstract  refined  escape  function  for  constants  */ 

Pf.       :     Exp  —*  Ep  ^  Dp     /*  Abstract  refined  escape  function  for  expressions  */ 
Ppr     :     Program  -^  Dp       /*  Abstract  refined  escape  function  for  programs  */ 

The  abstract  refined  escape  semantic  functions  are  given  in  Figure  3.6. 

The  abstract  value  of  cons  returns  a  single  refined  escape  pair  that  is  approximating 
a  list  of  refined  escape  pairs  by  taking  the  least  upper  bound  of  its  two  arguments.  The 
car^  denotes  a  car  that  is  applied  to  an  argimient  of  a  list  type  with  s  spines.  For  each 
car  in  a  program,  s  can  be  determined  statically  by  type  checking.  It  may  be  arbitrarily 
large,  but  is  fixed  at  compile-time.  The  abstract  value  of  car  is  defined  as  follows:  car^ 
takes  a  list  with  s  spines  as  an  argiunent,  and  returns  a  list  with  (s  —  1)  spines  when  s  >  1 
or  a  non-list  object  when  s  =  1.  In  any  case,  the  result  carmot  contain  an  interesting 
object  with  s  spines.  The  abstract  value  of  cdr  just  returns  its  argxmient  list,  eiivp  is 
any  abstract  refined  escape  environment  in  JSp,  and  nullenvp  is  an  abstract  refined  escape 
environment  that  maps  every  identifier  to  the  least  element  of  its  abstract  refined  escape 
semantic  domain. 

The  safety  of  interpretation  imder  the  abstract  refined  escape  semantics  with  respect 
to  the  exact  refined  escape  semantics  can  be  proved  as  follows.  Let  u  and  v  be  values  of 
an  expression  e  of  type  r  in  the  abstract  refined  escape  domain  Dp  and  the  exact  refined 
escape  domain  Dp,  respectively.  Let  ti  be  the  number  of  arguments  that  the  type  r  can 
take  before  returning  a  value  of  primitive  type.  We  say  that  the  abstract  refined  escape 
semantic  value  u  is  a  safe  approximation  (with  respect  to  refined  escape  information)  of  the 
exact  refined  escape  semantic  value  v  iff 

(  U  P(i))E  (NAP;t(ti,5i,...,5fc))(i) 

pin  NAPi,{v,ti,...,tt) 
lor  all  k  <  n  where  5,  is  a  safe  approximation  of  t^  for  all  i  <  k. 

Theorem  3.1  (Safety)  For  any  expression  e,  and  environments  enVp  and  enVp  such  that 
for  all  y,  enVply]  is  safe  for  cnVplyj,  PglejcfiVp  is  safe  (with  respect  to  refined  escape 
information)  for  P^lelenVp. 


Pclcj 

A Icons] 
Alcar^l 


Pjcdrl 
Pjnulll 


=     ((0,0),  err),c  =  {...,-1,0, 1,.. .,  true,  false} 
=     J-T-  (The  bottom  element  in  Dp) 
=     {{0,0),\x.{x^,y\y.xUy)) 
=     ((0,0),Aa;.sub=(a;)) 

where 

sub=(z)  =  if  (z(i)(2)  =  s)  then  ((2(i)(i),max(2(i)(2)  -  1,0)), 2(2))  else  z 
=     ((0,0),Ax.x) 
=     ((0,0),Ax.((0,0),err)) 


PMefiVp  =     PcM 

P^lxjenvp  =     envplxj 

jPefei  +  e2}envp     =     ((0,  0),  err)  /*  same  for  ei  -  €2  and  ei  =  62  */ 

Pe|if  ei  then  62  else  esjenvp     =     (/'ele2lenfp)(2)  LI  (-Pelesjenup) 

Pe[eie2lent;p  =     (Pe|Iei]ent;p)(2)  (Pelezlent/p) 

Pcllamhda{x). ejenvp     =     {V,Xy.Pelejehvp[x  1-^  y]) 

where 

F=(0,0)([J(en,;p[zl)(i))and 

F  =  Set  of  free  identifiers  in  (lambda(2').e). 
Pelletrec  ^1  =  er, . .  .;2:„  =  e„;  in  e|eniip     =     PeleJenVp 

where  env'  =  enVp[xi  h^  Pele-ijenv'    . .  .,x„  h-.  Pe|e,Jenu'] 


Arb^ 


=     PApTinullenVn 


Figure  3.6:  Abstract  Refined  Escape  Semantic  Functions 
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Proof  :     We  can  prove  by  structural  induction  on  expression  e. 

I.  Base  Case: 

1.  e  =  c:    Pelcjenvp  =  P.lcj  and  PeicjenVp  =  Pdcj.   For  c  G  {. . .  .    -1,    0.    1 

true,  false,  nil,  null  }  ,  Pc|c|  =  Pdcj  =  {{0,0),  err).  It  holds  for  c  =  cons,  because, 
if  xi  and  X2  are  safe  for  j/i  and  3/2  respectively,  ^i  U  X2  is  also  safe  for  a  list  consisting  of  yi 
and  3/2.  For  c  =  car^,  it  holds  because  if  x  is  safe  for  y  then  sub^(a;)  is  safe  for  first(j/).  It 
holds  for  c  =  cdr,  because  P^cj  =  Pdcj  =  {{0,0),  Xx.x). 

2.  e  =  x:   Pel^jenVp  =  ehvplx}  and  Pelxlenup  =  en^;p|s].    Since,  for  all  y,  enVply}  is 
safe  for  envpfj/j,  it  clearly  holds. 

II.  Structural  Induction  Step:  Assume  that  PeleJ^^^p  is  safe  for  Pe|[e|enVp  for  expressions 
such  as  Co,  ei,  63, 63  and  e„  (structural  induction  hypothesis).  Then,  we  show  that  Pe|e]entip 
is  safe  for  Pe|e|eni;p  for  e  =  ei  +  €2,  if  ej  then  en  else  63,  6162,  lambda(a;).ei,  and 
letrec  xj  =  Ci; . . . ;  in  =  €„;  in  cq.  This  step  can  be  proved  in  an  exactly  same  way  to  the 
safety  proof  of  the  abstract  escape  semantics  with  respect  to  the  exact  escape  semantics.  D 

Theorem  3.2  (Termination)  For  any  (finite)  program  pr  G  Program,  Pp^lprJ  is  com- 
putable. 

Proof  :  Every  functional  in  the  refined  escape  domain  that  is  defined  through  the  abstract 
refined  escape  semantic  fimctions  is  composed  of  the  operators  such  as  the  least  upper  boimd 
operator  U  and  sub^,  which  are  monotonic.  Furthermore,  each  subdomain  Dp  is  finite.  □ 

3.2.4      Refined  Escapement  Testing 

The  abstract  refined  escape  semantics  can  be  used  as  a  basis  for  inferring  refined  escape 
information  because  interpretation  under  this  semantics  is  effective.  We  describe  the  refined 
escape  testing  algorithms  in  which  the  abstract  functions  are  used  to  detect  the  refined 
escape  properties  of  the  corresponding  functions  in  a  program. 

Global  Refined  Escape  Test 

Given  a  function  f  xi  X2  .  ■ .  x^  =  bodyj  of  arity  n,  the  position  i  of  an  interesting 
parameter,  and  an  abstract  refined  escape  semantic  environment  envp  mapping  /  to  an 
element  of  Dp,  the  global  refined  escape  test  function  G.rescape?  determines  how  much  of 
the  z'    parameter  of  /  could  possibly  escape  /  globally.  It  is  defined  as  follows: 

G_rescape?(/,z,  ent;p)  =  (Pel/a;i    ...  2.-„l  enVp{x,  ^  j/,])(i) 
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where 

yi  =  {{l,Si),W'^'),  I*  The  i"*  parameter  is  an  interesting  object  */ 

Si  is  the  number  of  spines  of  the  z"*  parameter  of  /  (if  it  is  a  list  type,  otherwise  5,  is  0), 
for  all  j  <  n  and  j  ^  i, 

yj  =  {(0,  0},iy^-'),  /*  Other  parameters  are  not  interesting  objects  */ 

and  r,  is  the  type  of  the  f""  parameter  of  /.  Note  that  the  whole  z""  argument  with  5, 
spines  is  interesting,  and  any  other  argument  is  not  interesting.  Then,  from  the  result  of 
the  global  refined  escape  test  function,  we  can  conclude  as  follows: 

•  K  G_rescape?(/,z, enz;p)  =  (0,0)  then  we  conclude  that  none  of  the  f""  argument 
escapes  /  in  any  possible  application  of  /  to  n  argimients. 

•  If  G_rescape?(/,  i,  envp)  =  {l,k)  then  we  conclude  that,  if  5,  >  1  then,  the  top  (5,  -  k) 
spines  of  the  i"*  argument  do  not  escape  /  in  any  possible  application  of  /  to  n 
argimients,  but  the  bottom  k  spines  of  the  i'''  argument  could  escape  /  in  some 
application  of  /  to  n  arguments.  If  Si  =  0  then  the  i'-^  argument,  which  is  not  a  list 
type,  could  escape  in  some  application  of  /  to  n  argimients. 

Local  Refined  Escape  Test 

Given  a  function  f  Xi  X2  .  ■  ■  x„  =  bodyj  of  arity  n  in  an  application  /  cj  ...  e„,  the 
position  i  of  an  interesting  parameter,  and  an  abstract  escape  semantic  environment  enVp 
mapping  /  and  the  free  identifiers  within  Ci  through  e„  to  elements  of  Dp,  the  local  escape 
test  function  L_rescape?  determines  how  much  of  the  f""  parameter  of  /  could  escape  /  in 
the  evaluation  of  /  ej    ...  e„.  It  is  defined  as  follows: 

L_rescape?(/,2,  ei,...,e„,enz;p)  =  (Pel/ ii   •••  x^l  efiVp[x,  ^  yi\)^-^) 
where 

2/,  =  ((1,  5,),  (Pelc:!  c'^'^p)(2))>  /*  The  i*-^  parameter  is  an  interesting  object  */ 

5,  is  the  number  of  spines  of  the  z"*  parameter  of  /  (if  it  is  a  list  type,  otherwise  5,  is  0), 
and  for  all  j  <  n  and  j  7^  z, 

Vj  —  ((0,  0),  (^el^jl  cnz;p)(2)).  /*  Other  pairameters  are  not  interesting  objects  */ 
Then,  from  the  result  of  the  local  refined  escape  test  function,  we  can  conclude  that: 
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•  If  Lj-escape?(/,  i,  Ci, . .  .,en,enVp)  =  (0,0)  then  none  of  the  f""  argument  escapes  /  in 
the  particular  application  of  /  to  Cj  through  e„. 

•  If  L_rescape?(/,  2,  ei, ...,  Cn,  enVp)  =  (l,^')  then  we  conclude  that,  if  s,  >  1  then,  the 
top  (5,  -  k)  spines  of  the  i"^  argument  do  not  escape  /  in  the  particular  application 
of  /  to  ei  through  £„,  but  the  bottom  k  spines  of  the  z*''  argument  could  escape.  If 
Si  =  0  then  the  z"'  argument,  which  is  not  a  list  type,  could  escape  in  the  particular 
application  of  /  to  Cj  through  e„. 

Examples 

As  an  example,  consider  the  following  partition  sort  program: 

letrec  ps    x   =   if    (null  x)    then  nil 

else   letrec  y   =    split    (car   x)    (cdr   x)    nil   nil; 
in  append    (ps    (car   y)) 

(cons    (car  x)    (ps    (car   (cdr  y)))); 

split   p  X   1   h   =    if    (null   x)    then    (cons  1    (cons   h   nil)) 
elseif    (car   x)<p  then 

split   p    (cdr   x)  (cons    (car   x)    1)    h 

else   split   p    (cdr   x)    1  (cons    (car   x)    h) ; 

append  x   y   =    if    (null   x)    then  y 

else   cons    (car   x)    (append    (cdr   x)    y) ; 
in  ps    [5,2,7,1,3,4] 

We  assume  that  the  type  of  each  function  is  given  by 

ps  :  int  list  — ►  int  list 

split  :  int  —  int  list  — ►  int  list  -^  int  list  -^  int  list  list 

append  :  int  list  -^  int  list  -^  int  list 

From  type  checking,  each  car  in  the  program  can  be  annotated  as  follows: 

ps   X   =   if    (null   x)    then  nil 

else   letrec   y   =    split    (CARl    x)    (cdr   x)    nil  nil; 
in   append    (ps    (CAR2   y)) 

(cons    (CARl    x)    (ps    (CAR2    (cdr   y)))); 
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split   p   X   1   h   =    if    (null   x)    then    (cons  1    (cons   h  nil)) 
elseif    (CARl   x)<p   then 

split   p    (cdr  x)  (cons    (CARl    x)    1)    h 

else   split   p    (cdr   x)    1  (cons    (CARl   x)    h) ; 

append  x  y  =   if    (null  x)   then  y 

else   cons    (CARl   x)    (append    (cdr   x)    y) ; 

where  CARi  denotes  a  car  that  takes  as  its  argument  a  list  with  i  spines.  The  refined 
escape  semantic  values  append,  split,  and  ps  of  append,  split,  and  ps  (shown  uncurried 
for  convenience)  are  expressed  as  follows: 

append  x  y   =   y  U  (sub^(z)  U  append  x  y) 

splitpxlh    =    lUhl\{splitpx  (suh^{x)Ul)h)U{splitpx    (sub^(i)  U /i)) 

ps  X   =   append  {ps  suh^{split  suh^{x)  X  {{0,0)err}  {{Q,0}err))) 

(sub^(z)U(p5  suh^{split  sub^(a;)  x  ((0,0)err)  ((0,0)e7-r-))) 

The  meaning  of  each  function  in  the  refined  escape  semantic  domain  is  found  by  fixpoint 
iteration.  The  fixpoint  iteration  for  append: 

append'^^'i  x  y     =  _L,„(  i,,t 

append^^^  x  y     =  y  U  (sub^(x)  U  append^^^  x  y) 

=  y  Li  sub'(i) 

append^"^^  X  y     =  y  U  [sxxh^  [x]  U  append^^^  x  y) 

=  j/U  (sub^(2;)  U  (3/Usub^(x))) 

=  2/Usub'(i) 

Since  append^^^  =  append^^\  we  have  that 

append  =  ((0,  0),  \x.{x^■^),  Xy.y  U  sub^(r))). 
The  fixpoint  iteration  for  split: 
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split'-^'>  p  X  I  h     =     lU  h\J  ±(^i^tii,t)ii,t^ -^{intli,t)list 

^    luh 

split^^^pxlh     =  I  U  h  U  [split^'^^  p  X  {suh'^  (x)  U  I)  h)  U  {split'^'^^  p  X    {suh'^  {x)  U  h)) 

=  lUhU  ((subi(x)  Ul)Uh)U  ((subi(x)  U  h)) 

=  /U/iUsub^(x) 

split^^^pxlh     =  ZU /iU(5p/it(2'px  (subi(x)  U/) /i)  U  (5p/z<(2)pz   (subi(a;)  U /i)) 

=  ZU  /iU((subi(a;)U  Z)  U  /i)  U  (/ U  (sub^(i:)  U  h)  Usubi(z)) 

=  ZU/iUsub^(x) 

Since  split^^^  =  split^^\  we  have  that 

split  =  ((0,  0),  Ap.(p(i),  Aa;.(p(i)  U  a;(i),  AZ.(p(i)  U  X(i)  U  Z(i),  A/i.Z  U  /i  U  sub^a;)))))- 
The  fbcpoint  iteration  for  ps: 

ps^°^   X       -        l^r^t  list 

p^fi'  x     =  append{ps^°^  sub2(subi(a;)))  (subi(z)  U  (psC')  sub2{subi(i))) 

=  append  li„t  li,t  (sub^(sub^(2))  U  ±,rit  Ust) 

=  sub^(x) 

ps'^'  X     =  appendlps'-^^  sub^(sub^(a;)))  (sub^(i)  U  (p^^^^  sub^(sub^(x))) 

=  append  sub^(sub^(sub^(x)))  (sub^(i)  U  sub^(sub^(sub^(2))) 

=  sub^(i) 

Since  p^'^'  =  p^^^^,  we  have  that 

ps  =  ((0,0),A2.subi(z)). 

Let  envp  be  defined  as  eiivp  =  [append  i— >  append,  split  i— >  split, ps  i-^  ps].  Then, 

G.rescape? (append,  1,  enup)     =     (P(,|append  x   y]en?;'p)/]) 

=     (((0,0>,err)UsubM((l,l),err)))(i)         . 
=      (1,0) 

where  env'p  —  ehvp\r.  \-^  ((1, 1),  err),^  h- >  ((0,  0),  err)]. 

G-rescape?  (append,  2,  en?ip)     =     (P^lappend  x   ylenv'p)(i) 

=     ({(0,0),e7T)Usubi(((l,l),err)))(,) 
=     (1,1) 

where  env'p  -  ehVp\x  i-^  ((0,  0),  err),  y  i-^  ((1,  1),  err)].  Thus,  we  can  conclude  that  append 
returns  all  of  its  second  argument  y,  and  all  but  the  top  spine  of  the  first  argument  x. 

63 


G_rescape?(split,  1,  enup)     =     (Pe|split  p  x   1  h|ent;'p)(i) 

=     (((0,0),err)u({0,0),err)Usubi(((0,0),e7T)))(i) 
=     (0,0) 

where  env'p  =  eni;p[p  i—>  ((1,  0),  err),x,  l,h  h^  ((0,  0),  err)]. 

G-rescape?(split,  2,  enup)     =     (P^lsplit  p  x  1  h|enT;'p)(i) 

=     (((0,0),err)u((0,0),err-)Usubi(((l,l),err)))(,, 
=     (1,0) 

where  env'p  =  envp[x  h->  ((1, 1),  err),p,  l,h  i-*  ((0,  0),  err)]. 

G-rescape?(split,  3,  eni/p)     =     (Pefsplit  p  x  1  h|env'p)(i) 

=     (((1,1),  err)  U  ((0,0),  err)  Usub^(((0,0),erT)))(i) 

=  (la) 

where  env'p  =  eni;p[l  i— »  ((1, 1),  err'),p,x,h  >—*  ((0,  0),  err)]. 

G_rescape?(split,  4,  enup)     =     (P^lsplit  p  x  1  h]env'p)M) 

=     (((0,0),err)u((l,l),err)Usubi(((0,0),err)))(,) 

=     (1,1) 

where  env'p  =  ent;p[h  h->  ((1, 1),  err),p,  x,  1  >-^  ((0,  0),  err)].  Thus,  we  can  conclude  that 
split  returns  all  of  its  third  and  fourth  arguments  1  and  h,  none  of  the  first  argument  p, 
and  all  but  the  top  spine  of  the  second  argument  x. 

G_rescape?(ps,l,  envp)     =     (Pelps   xj  ent;p[x  i—  ((1,  1),  err)])(i) 

=     (sub'(((l,l),err)))(i) 
=     (1,0) 
Thus,  we  conclude  that  ps  returns  all  but  the  top  spine  of  its  argument  x. 

3.3      Improving  Precision  of  Refined  Escapement 

We  describe  an  improved  abstraction  of  the  exact  refined  escape  semantics  achieved  by 
extending  the  basic  abstract  refined  escape  domain  to  include  additional  information  about 
the  positions  of  objects  in  a  list.  For  each  expression,  its  corresponding  value  in  the 

improved  abstract  refined  escape  semantic  domain  tells  us  how  much  of  an  interesting  object 
may  be  contained  at  some  position  in  the  value  of  the  expression  ("maybe  partial-escape 
and  where").    The  basic  improved  abstract  escape  domain.  Bp,  for  some  fixed  d  and  p  is 
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(l,d,0) 


(l,cl,p-l) 
(l,d,p) 
(1,0,0) 


(l,0,p-l) 
(1,0,  p) 
(0,0,0) 

Figure  3.7:  The  Improved  Abstract  Basic  Refined  Escape  Domain 
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a  ((<i+  l)(p  +  1)  +  l)-element  domain  of  triples  as  shown  in  Figure  3.7.   The  ordering  on 
triples  in  Bp  is  defined  as  follows: 

(0,0,0)C  (l,0,p)C  (l,0,p-  1)  C  ...E  (1,0,0)... (l,d,p)C  (l,d,p-l)  C...C  (l,d,0} 

The  interpretation  of  the  elements  of  Bp  is  defined  as  follows: 

•  (l,^,^•)  :  Only  the  bottom  <  i  spines  of  an  interesting  object  may  be  contained  only 
at  positions  >  k  in  the  value  of  the  expression,  if  that  value  is  a  hst.  (If  an  interesting 
object  is  not  a  list  then  i  will  always  be  0,  which  means  that  an  indivisible  interesting 
object  may  be  contained  in  the  value  of  the  expression.) 

•  (0, 0,  0)  :  No  part  of  any  interesting  object  is  contained  in  the  value  of  the  expression. 

The  improved  abstract  refined  escape  semantic  domain  Dp  and  the  domain  Ep  of  improved 
abstract  refined  escape  enviroimients  are  defined  as  follows: 

Dp     =     2lj    p  I*  Improved  abstract  refined  escape  semantic  domain  */ 

T 

Ep     =     Id  -^  Dp     I*  Domain  of  improved  refined  escape  environments  */ 

The  improved  abstract  refined  escape  subdomains  DZ,  for  expressions  of  type  t  are  defined 
as  follows: 

Z)p"'  =     Bp  X  [err]  improved  abstract  subdomain  for  integers 

^Ik>oI         _     Bp  X  [err]  improved  abstract  subdomain  for  booleans 

£)T,  — T2     _     Bp  X  {Dp^  —>  Dp^)     improved  abstract  subdomain  for  functions 


'p  -      ±Jp  ^  v-^p    ^  -^p 

The  improved  abstract  refined  escape  semantic  functions  are  as  follows 


£)T  hst       _     £)T  improved  abstract  subdomain  for  lists 


Pc 
Pe 


Ppr 


Con  -^  Dp  I*  Improved  semantic  function  for  constants  */ 


Exp  ^  Ep  ^  Dp     I*  Improved  semantic  function  for  expressions  */ 
Program.  — »  Dp       /*  Improved  semantic  function  for  programs  */ 

The  improved  abstract  refined  escape  semantic  function  P^  :  Con  — ►  Dp  that  gives  refined 
escape  meaning  to  constants  is  given  in  Figure  3.8.  The  improved  abstract  value  of  cons 
takes  two  arguments,  and  returns  an  improved  refined  escape  pair  of  their  least  upper  bound 
by  updating  the  position  information  of  an  interesting  object  in  the  result  hst.  The  improved 
abstract  value  of  car^  returns  its  argument  according  to  the  position  of  an  interesting  object, 
car^  takes  a  list  with  s  spines  and  returns  the  element  that  was  in  the  O""  position  and 
has  (s  -  1)  spines.    Thus,  the  result  cannot  contain  an  interesting  object  with  s  spines  or 
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P,lc}  =     ((0,0,0),  err),    c{.  .., -1,  0, 1, ...,  true,  false} 

Pclnir '"'I     =     It  (The  bottom  element  in  D^) 
Pjcons]  =     ((0,0,0),A2;.(a;(i),A2/.rpush(2:,2/)))) 

where 
rpush(a;,7/)  =     if  (2;(i)(i)  =  1) 

then  ((1,  a;(i)(2)  U  y(i)(2),  0),  X(2)  U  2/(2)) 
elseif  (2/(i)(i)  =  1) 

then  ((l,2/(i)(2),min(j/(i)(3)  +  l,p)),X{2)  U  2/(2)) 
else  ((0,0,0),  1(2)  U  2/(2)) 
Pelcar^I  =     ((0,0,0),A2;.rsub"(a;)) 

where 
rsub=(2)  =     if  (^'(i)(i)  =  0)  or  (z^,)^^)  >  0)    then  ((0,0,  0),  .-(2)) 

else  ((dec=(2(i2)),0),2(2)) 
dec^(2/)  =       if  (2/(1)  -1  =  5)  then  (max(2/(i)  -  1,  0),  y(2)) 
else  y 
Pelcdrl  =     ((0,0,0),Aa;.rrest(a;)) 

where 
rrest(r)  =     ((;(i)(i),  ;(i)(2),  max[2(i)(3)  -  1,0]),  2(2)) 
PjnullI  =     ((0,0,0),Aa;.((0,0,0), err) 

Figure  3.8:  Improved  Abstract  Refined  Escape  Semantic  Functions 


that  occurred  at  a  position  >  1  in  the  original  list.  The  improved  abstract  value  of  cdr  also 
updates  the  position  information  appropriately.  Note  that  the  improved  abstract  refined 
escape  semantic  function  P^  for  cons,  car  and  cdr  provides  more  precise  escape  information 
than  the  abstract  refined  escape  semantic  function  Pc- 

The  improved  abstract  refined  escape  semantic  function  P^  :  Exp  -^  Ep  ^>  Dp  that  gives 
refined  escape  meaning  to  expressions,  and  the  improved  abstract  refined  escape  semantic 
function  Pp^  :  Program  — >  Dp  that  gives  refined  escape  meaning  to  programs  are  defined 
similarly  to  the  abstract  refined  escape  semantic  function  P^  and  Pp^  respectively. 

The  safety  of  interpretation  under  the  improved  abstract  refined  escape  semantics  with 
respect  to  the  exact  refined  escape  semantics  can  be  proved  as  follows.  Let  u  and  v  be 
values  of  an  expression  e  of  type  r  in  Dp  and  Dp^  respectively.  Let  n  be  the  number  of 
arguments  that  the  type  r  can  take  before  returning  a  value  of  primitive  type.  We  say  that 
the  improved  abstract  refined  escape  semantic  value  u  is  a  safe  approximation  (with  respect 
to  refined  escape  information)  for  the  exact  refined  escape  semantic  value  v  iff 

(  U  P(l))  E  (NAPfc(u,5i,...,5fc))(i,(i,2) 

pin  NAPk{v,ti,...,tk) 

and 

{MINpinNAP.ivM tt)i:p|,„i)=iPositionofp)  >  (^AFk{u,su  ■  ■  .,Sk))(i)(3) 

for  all  k  <  n  where  Si  is  a  safe  approximation  for  i,  for  all  i  <  A;. 

Theorem  3.3  (Safety)  For  any  expression  e,  and  environments  envp  and  ehvp  such  that 
for  all  y,  enVp\y\  is  safe  for  enVp\y\,  Pe\e\enVp  is  safe  (with  respect  to  refined  escape 
information)  for  Pg\e\enVp. 

Proof  :     We  can  prove  by  structural  induction  on  expression  e. 

I.  Base  Case: 

1.  e  =  c:  Pelcjenup  =  Pcfcl  and  Pelclenvp  =  Pclcj.  Force  { -1.0.1,    ....    true, 

false,  nil,  null  }  ,  P,\c\  =  Pdcj  -  ((0,  0,  0),  err).  It  holds  for  c  =  car,  because  if  ?i 
and  X2  are  safe  for  j/i  and  j/2  respectively  then  rpush(i,  j/)  is  also  safe  for  a  list  of  ?/i  and  j/2- 
For  c  =  car^,  it  holds  because  if  a'  is  safe  for  y  then  then  rsub^(x)  is  also  safe  for  first(j/). 
It  holds  for  c  =  cdr,  because  if  a-  is  safe  for  y  then  then  rrest(a-)  is  also  safe  for    second(y). 

2.  e  =  x:  Pdx\envp  =  envp\x\  and  P^xlenvp  -  envp\x\.  Since,  for  all  y,  ehvp\y\  is 
safe  for  ent;p[y|,  it  cleairly  holds. 

II.  Structural  Induction  Step:   Assume  that  Pj{e\ehVp  is  safe  for  Pde\enVp  for  expressions 
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RES 


SS  lARES 


ARES  "information  content" 


Figure  3.9:  Relationship  cunong  Standard  and  Refined  Escape  Semantics 

such  as  Co,  ej,  62,  £3  and  e„  (structural  induction  hypothesis).  Then,  we  show  that  PelejenVp 
is  safe  for  Pe|e|ent;p  for  e  =  ei  +  62,  if  Cj  then  62  else  €3,  6162,  lainbda(a;).ei,  and 
letrec  ii  =  ej; . . .;  z^  =  e^;  in  Cq.  This  can  be  proved  in  an  exactly  the  same  as  the  proof 
of  safety  of  the  abstract  refined  escape  semantics.  □ 

Theorem  3.4  (Termination)  Fot  any  (finite)  program,  pr  6  Program,  Pp^lprj  is  com- 
putable. 

Proof  :  Every  functional  in  the  improved  escape  domain  that  is  defined  through  the 
abstract  improved  refined  escape  semantic  functions  is  composed  of  the  operators  such  as 
the  least  upper  bound  operator  U,  rpush,  rsub^,  and  rrest.  rpush,  rsub^  and  rrest  are  all 
monotonic  operators.  Also,  each  subdomain  D^  is  finite.  □ 

Theorem  3.5  (Precision  Improvement)  The  abstract  refined  escape  semantics  is  equiv- 
alent (with  respect  to  refined  escape  information)  to  the  improved  abstract  refined  escape 
semantics  with  p  =  0.  Thus,  the  improved  abstract  refined  escape  semantics  with  p  >  0 
provides  more  precise  escape  information  than  the  abstract  refined  escape  semantics. 

Proof  :     This  can  be  proved  in  a  similar  way  to  the  proof  of  Theorem  2.5.  □ 

The  relationships  among  the  standard  semantics  (SS),  the  exact  refined  escape  semantics 
(RES),  the  abstract  refined  escape  semantics  (ARES)  and  the  improved  abstract  refined 
escape  semantics  (lARES)  are  shown  in  Figure  3.9 
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Improved  Global  Refined  Escape  Test 

Given  a  function  /  Xj  i2  •  •  ■  ^n  =  bodyf  of  arity  n,  the  position  i  of  an  interesting 
parameter,  and  an  improved  abstract  refined  escape  semantic  environment  efiVp  mapping 
/  to  an  element  of  Dp,  the  global  improved  refined  escape  test  function  GJrescape?  which 
determines  how  much  of  the  i"*  parameter  of  /  could  possibly  escape  /  globally  is  defined 
as  follows: 

GJrescape?(/,  z,enup)  =  {Pelf  x^   ...  z„I  envp[xi  i->  J/,])(i)(i,2) 

where 

yi  =  {{l,Si,0),W'^'),  I*  The  z"'  parameter  is  an  interesting  object  */ 

Si  is  the  nvmiber  of  spines  of  the  z""  parameter  of  /  (if  it  is  a  list  type,  otherwise  s^  is  0), 
for  all  J  <  n  and  j  ^  i, 

yj  =  ((0,0,0),  VT'^-'),  /*  Other  parameters  are  not  interesting  objects  */ 

and  r,-  is  the  type  of  the  z"*  pairameter  of  /.  The  result  of  the  global  improved  refined  escape 
test  function  is  interpreted  as  follows: 

•  If  GJrescape?  (/,  i,  ehvp)  =  (0,  0)  then  we  can  conclude  that  in  any  possible  application 
of  /  to  n  arguments,  none  of  the  z""  argument  escapes  /. 

•  If  G_irescape?(/,  z',  enup)  =  (l,fc)  then  we  can  conclude  that  if  5,  >  1  then,  in  any 
possible  apphcation  of  /  to  n  arguments,  the  top  [si  —  k)  spines  of  the  z'""  argument 
do  not  escape  /,  but,  in  some  application  of  /  to  n  argvunents,  the  bottom  k  spines 
of  the  z"'  argument  could  escape  /.  If  5,  =0  then  in  some  application  of  /  to  n 
argimnents,  the  z'"*  argimient,  which  is  not  a  list  type,  could  escape. 

Improved  Local  Refined  Escape  Test 

Given  a  function  f  x\  X2  . .  ■  Xn  =  bodyj  of  arity  n  in  a  application  context  /  e^  ...  e„, 
the  position  z  of  an  interesting  parameter,  and  an  improved  abstract  escape  semantic  envi- 
roiuTient  eiivp  mapping  /  and  the  free  identifiers  within  Ci  through  e„  to  elements  of  Dp, 
the  local  escape  test  function  LJrescape?  which  determines  how  much  of  the  z""  parameter 
of  /  could  escape  /  in  the  evaluation  of  /  Cj   . . .  €„  is  defined  as  follows: 

L_irescape?(/,  z,ei,...,e„,eni;p)  =  {Pelf  x^    ...  x„j  eiiVplx,  •-►  !/,])(i)(i,2) 

where 
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J/,-  =  ((l,Si,0),(Pe[e,l  enz;p)(2)),  /*  The  z'''  parameter  is  an  interesting  object  */ 

Si  is  the  number  of  spines  of  the  z*''  parameter  of  /  (if  it  is  a  list  type,  otherwise  Si  is  0), 
and  for  all  j  <  n  and  j  ^  t, 

yj  =  ((0,0,0),  (^e|ejj  enup)(2))-  /*  Other  parameters  are  not  interesting  objects  */ 

The  result  of  the  local  improved  refined  escape  test  function  is  interpreted  as  follows: 

•  If  Ljrescape?(/,  t,  ei, . . .,  €„,  enVp)  =  (0,  0)  then  we  can  conclude  that  in  the  particular 
application  of  /  to  Cj  through  e„,  none  of  the  i     argument  escapes  /. 

•  If  L_irescape?(/,  i,  ei, . . .,  e„,  ent;p)  =  (l,fc)  then  we  can  conclude  that  if  5,  >  1  then, 
in  the  particular  application  of  /  to  ei  through  e„,  the  top  (sj  -  k)  spines  of  the  z"* 
argimient  do  not  escape  /,  but  the  bottom  k  spines  could  escape  /.  If  5,  =  0  then  the 
z"*  argument,  which  is  not  a  list  type,  could  escape  in  the  particular  application  of  / 
to  ei  through  e„. 

3.4      Comparison  to  Escape  Analysis  and  Complexity 

The  refined  escape  semantics,  the  abstract  refined  escape  semantics,  and  the  improved  ab- 
stract refined  escape  semantics  with  some  d  >  0  provide  more  refined  escape  information 
than  the  escape  semantics,  the  abstract  escape  semantics,  and  the  improved  abstract  escape 
semantics,  respectively.  The  relationship  among  the  standard  semantics,  the  escape  se- 
mantics, the  improved  abstract  escape  semantics,  the  abstract  escape  semantics,  the  refined 
escape  semantics,  the  improved  abstract  refined  escape  semantics,  and  the  abstract  refined 
escape  semantics  is  shown  in  Figure  3.10. 

The  abstract  interpretation  framework  for  the  refined  escape  analysis  is  the  same  as  that 
for  the  escape  analysis  presented  in  the  previous  chapter  except  for  the  size  of  the  abstract 
basic  domain.  While  the  escape  analysis  uses  a  two-element  domain,  the  refined  escape 
analysis  uses  a  (cf -f  2)-element  domain  where  d  is  fixed  and  greater  than  2.  Thus,  the  order 
of  worst-case  time  complexity  of  refined  escape  analysis  is  higher  than  but  is  comparable  to 
that  of  escape  analysis,  which  is  exponential. 
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Figure  3.10:  Relationship  among  Escape  and  Refined  Escape  Semantics 


Chapter  4 


Reference  Escape  Analysis 


In  reference  counting  schemes  for  automatic  storage  reclamation,  each  time  a  reference  to 
an  object  is  created  or  destroyed,  the  reference  count  of  the  object  needs  to  be  updated. 
This  may  involve  expensive  inter-processor  message  exchanges  in  distributed  enviroiunents. 
In  higher-order  functional  languages,  exact  information  about  the  lifetime  of  a  dynamically 
created  reference  to  a  heap-allocated  object  is  generally  unknown  at  compile-time.  Thus, 
updating  on  the  reference  count  of  the  object  is  performed  whenever  a  reference  to  the 
object  is  created  and  destroyed.  Such  information,  if  inferred  at  compile-time,  could  be 
useful  for  improving  the  reference  counting  scheme  for  both  uniprocessor  and  multiprocessor 
environments. 

In  this  chapter,  we  present  a  method  for  computing,  at  compile-time,  safe  information 
about  the  relative  lifetimes  of  dynamically  created  references  to  objects,  such  as  arguments 
and  local  objects  defined  within  a  function,  with  respect  to  the  lifetime  of  the  function  caU. 
As  before,  the  language  we  consider  is  a  higher-order,  monomorphic,  and  strict  functional 
language.  This  method  is  based  on  a  compile-time  semantic  analysis  called  reference  escape 
analysis.  First,  we  introduce  a  non-standard  denotational  semantics  called  reference  escape 
semantics  that  describes  the  actual  reference  escape  behavior,  but  is  incomputable  at  com- 
pile time.  An  abstraction  method  of  approximating  the  exact  reference  escape  semantics 
which  is  safe  with  respect  to  the  exact  reference  escape  semantics  and  is  computable  at 
compile-time  is  then  presented.  Based  on  the  abstract  reference  escape  semantics  and  func- 
tion transformation,  we  describe  the  reference  escape  testing  algorithms  which  determine 
reference  escape  information.  Another  safe  and  computable  abstraction  of  the  exact  ref- 
erence escape  semantics  called  improved  abstract  reference  escape  semantics  that  improves 
the  precision  of  reference  escape  information  using  the  position  information  of  objects  in  a 
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Figure  4.1:  Escapement  of  References 

list  structure  is  also  presented.  Finally,  the  complexity  of  the  reference  escape  analysis  is 
discussed. 

4.1      Escapement  of  References 

An  object  needed  in  more  than  one  place  during  a  program's  execution  is  typically  handled 
in  one  of  two  ways:  either  the  object  itself  is  copied  or  a  pointer  to  the  object  is  copied.  We 
describe  the  operational  model  in  which  references  are  created  and  destroyed.  We  choose  a 
model  that  is  commonly  implemented  in  LISP  and  functional  language  systems,  that  of  a 
call  by  value  language  with  pointer  semantics  for  heap  allocated  structtires.  References  are 
created  in  three  ways: 

1.  When  a  heap  allocated  object  is  created,  a  reference  to  that  object  is  created  and 
returned  by  the  allocation  procedure  (e.g.  cons). 

2.  When  a  heap  allocated  object  is  passed  as  a  parameter  in  a  function  call,  a  reference 
to  the  object  is  copied  into  the  activation  record  of  the  called  function. 

3.  When  an  assignment  occurs  (in  a  letrec,  for  example),  and  the  value  of  the  right  hand 
side  is  a  heap-allocated  object,  a  reference  to  the  object  is  copied  into  the  variable  (or 
record  field)  on  the  left  hand  side. 

Consider  the  following  function  definition: 

f   X   y   =      letrec   g   a   b   =    cons   a  b 


74 


in  cons  x    (g  x  y) 

When  f  is  called,  its  activation  record  contains  two  references  to  lists,  corresponding  to  the 
parcimeters  x  and  y.  Thus,  when  (g  x  y)  is  evaluated,  the  references  corresponding  to  x 
and  y  are  copied  into  the  activation  record  for  g.  Likewise,  any  argument  to  cons  that  is 
represented  by  a  reference  is  also  copied. 

We  analyze  the  lifetimes  of  a  reference  by  determining  its  escapement,  that  is,  whether 
or  not  a  reference  is  returned  out  of  the  scope  in  which  it  was  created.  When  does  a 
reference  escape?  Intuitively,  a  reference  can  escape  when  it  is  placed  in  a  structure,  or 
closure  that  escapes.  If  a  reference  does  not  escape  the  scope  of  its  creation,  no  reference 
coimting  operations  are  necessary  when  the  reference  is  created  or  destroyed.  In  the  above 
example,  when  the  references  corresponding  to  x  and  y  are  copied  into  g's  activation  record, 
no  reference  count  increment  operation  is  required.  Likewise,  when  g  returns,  no  decrement 
operation  is  required.  However,  when  a  cons  cell,  corresponding  to  (cons  a  b),  is  created, 
the  reference  counts  of  the  objects  pointed  to  by  a  and  b  must  be  incremented.  This  is 
because  the  lifetime  of  the  cons  cell  exceeds  that  of  g  and  f ,  and  it  cannot  be  determined 
at  compile  time,  when  the  references  contained  in  the  cons  cell  wiU  be  destroyed. 

We  formally  define  the  notion  of  escapement  of  references,  and  illustrate  it  in  Figure  4.1. 

Definition  4.1  (Global/Local  Reference  Escapement)  Given  a  function  /  with  n  for- 
mal parameters  and  m  locally  defined  objects,  the  j  occurrence  of  the  i  parameter  or 
locally  defined  object  is  said  to 

•  reference-escape  the  function  call  to  /  globally  if,  in  some  possible  application  of  /  to 
n  arguments,  the  reference  associated  with  Xi  outlives  the  the  function  call  (by  being 
contained  in  the  result  of  the  function  application). 

•  reference-escape  the  function  call  to  /  locally  in  (/  ej  ...  e„)  if,  in  the  particular 
function  application  of  (/  ej  ...  e„),  the  reference  associated  with  a:,  outlives  the 
activation  of  the  function  call. 

From  the  escapement  of  a  reference  with  respect  to  its  defining  function,  we  can  deduce 
its  lifetime:  If  the  reference  associated  with  an  occurrence  of  a  parameter  or  local  object 
does  not  escape  the  function  call  globally  then  we  can  conclude  that  the  lifetime  of  the 
reference  is  confined  to  the  lifetime  of  any  possible  call  to  the  function.  Similarly,  if  it  does 
not  reference-escape  the  function  call  locally  in  a  particular  function  application  then  we 
can  conclude  that  the  lifetime  of  the  reference  is  confined  to  the  lifetime  of  that  particular 
function  call. 
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We  will  develop  a  general  method  for  higher-order,  monomorphic,  strict  functional  lan- 
guages to  answer  the  following  questions  at  compile-time: 

•  Given  a  function  and  an  occurrence  of  a  parameter  or  local  object,  does  the  reference 
associated  with  the  occurrence  reference-escape  the  function  call  globally  ? 

•  Given  a  function  in  a  particular  application  context  and  an  occurrence  of  a  parameter 
or  local  object  that  is  defined  within  the  function,  does  the  reference  associated  with 
the  occurrence  reference-escape  that  function  call  ? 

4.2      Function  Transformation 

In  order  to  make  each  occurrence  of  each  parameter  of  a  function  distinct,  we  introduce  an 
auxihary  function  /'  for  each  function  /.  Then,  we  perform  reference  escape  testing  on  /' 
to  determine  reference  escape  property  of  each  occurrence  of  each  parameter  of  /.  Given  a 
function 

f  Xi    ...   Xr,    =    e, 

the  auxiliary  function  /'  is  given  as  foUows: 

f  x-ii   ...  a;i„(i)  ...  a:„i   ...  2:no(n)    =    e' 

where  o{i)  is  the  number  of  occurrences  of  x,  in  e  and  e'  is  derived  from  e  by  replacing  the 
j"*  occurrence  of  a;,  by  a;,_,  for  all  i  and  j.  Note  that  each  parameter  of  /'  will  now  have 
only  one  occurrence,  and  /'  will  be  never  called  from  anywhere  and  thus  is  not  recursive. 
To  determine  the  escape  behavior  of  references  associated  with  occurrences  of  parameters 
of  /,  we  perform  the  test  on  its  auxiliary  function  /'.  For  example,  consider  the  following 
function. 

f  X  y  =   letrec  g  a  b  =  cons  a  b; 
in  cons  x  (g  x  y) 

An  auxiliary  function  f  derived  from  f  is  given  as  follows: 

f  xl  x2  y  =   letrec  g  a  b  =  cons  a  b; 
in  cons  xl  (g  x2  y) 


Figure  4.2:  The  Basic  Reference  Escape  Domain 

4.3      Exact  Reference  Escape  Semantics 

We  introduce  an  exact  but  uncomputable  non-standard  denotational  semantics,  called  ref- 
erence escape  semantics,  which  describes  the  complete  escaping  behaviors  of  references  for 
functions  in  a  program.  The  reference  associated  with  each  occurrence  of  a  parameter  or 
local  object  will  be  analyzed  separately  to  determine  its  reference-escape  behavior.  We 
say  that  a  reference  is  interesting  if  it  is  the  one  whose  escape  behavior  we  are  trying  to 
determine.  Thus,  our  reference  escape  semantics  is  defined  in  terms  of  a  single  interesting 
reference. 

Representing  Reference  Escape  Information 

The  meaning  we  will  attach  to  the  syntax  of  our  language  is  information  about  escaping 
references.  For  each  expression,  we  want  its  corresponding  value  in  the  reference  escape 
semantic  domain  to  be  able  to  tell  us  if  an  interesting  reference  is  not  contained  in  the  value 
of  the  expression  ("non-reference-escape"),  or  if  an  interesting  reference  is  contained  in 
the  value  of  the  expression  ("reference-escape").  Under  the  non-standard  reference  escape 
semantics,  we  represent  the  meaning  of  an  expression  as  a  pair,  called  a  reference  escape 
pair, 

1.  whose  first  element  denotes  the  containment  of  an  interesting  reference  in  the  value 
of  the  expression,  and 

2.  whose  second  element  denotes  the  functional  behavior  of  the  expression  defined  over 
the  reference  escape  domain  when  the  expression  itself  is  applied  to  another  expression. 

For  a  non-list  type  expression,  the  corresponding  value  in  the  non-standard  reference  escape 
semantic  domain  D^  has  two  components;  The  first  component  is  an  element  of  a  domain 
called  a  basic  reference  escape  domain,  Br  which  is  a  two  element  domain  showned  Fig- 


ure  4.2.  The  ordering  is  defined  as  0  C  1.  The  interpretation  of  elements  of  Br  is  defined 
as  follows: 

•  1  :  An  interesting  reference  is  contained  in  the  value  of  the  expression. 

•  0  :  No  interesting  reference  is  contained  in  the  value  of  the  expression. 

For  expressions  which  have  no  higher-order  behavior,  err  which  is  a  function  that  can  never 
be  applied,  is  used.  For  a  list  type  expression,  the  corresponding  value  in  the  reference 
escape  semantic  domain  is  a  list  that  consist  of  corresponding  reference  escape  values  of  its 
components. 

Reference  Escape  Semantic  Domains 

The  reference  escape  semantic  domain  Dr  and  the  domain  E^  of  reference  escape  environ- 
ments are  defined  as  follows: 

Dr     =     2^Dr  /*  Reference  escape  semantic  domain  */ 

T 

Er      =     Id  —*  Dr     I*  Domain  of  reference  escape  environments  */ 

The  reference  escape  domain  Dr  is  a  sum  domain  consisting  of  each  subdomain  for  each 
type.  The  reference  escape  subdomain  Dl  for  expressions  of  type  r  is  defined  as  follows: 

Z)^"'  =  Br  y.  {err]  subdomain  for  integers 

j^hool  _  i?,.  X  {err]  subdomain  for  booleans 

£)Ti^T2  _  Br  y.  (Dl^  ^  D^)  subdomain  for  functions  of  type  tj  -+  T2 

Dl '"'  =  {Br  X  {err})  +  (I>;  x  D^ '"')  subdomain  for  lists  of  type  t  list 

Reference  Escape  Semantic  Functions 

The  non-standard  reference  escape  semantic  functions  are  defined  as  follows: 

Re       :     Con  —*  Dr  j*  Reference  escape  semantic  function  for  constants  */ 

i?e       '■     Exp  ^  Er  ^  Dr     /*  Reference  escape  semantic  function  for  expressions  */ 
Rpr     '•     Program  -^  Dr       /*  Reference  escape  semantic  function  for  programs  */ 

The  semantic  equations  for  the  reference  escape  semantic  functions  are  expressed  in  Fig- 
ure 4.3.  Note  that  Oracle  is  used  to  resolve  the  exact  behavior  of  the  conditional  expression 
if,  which  relies  on  the  standard  semantics.  enVr  is  any  exact  reference  escape  environment 
in  Er,  and  nullenvr  is  a  reference  escape  environment  that  maps  every  identifier  on  to  the 
least  element  of  its  reference  escape  domain. 


Rclcj  =  (0,err),    cG  {..., -1,0,1, ..., true, false^r'"'} 

i?4consl  =  (0,Ai.(a;(i),  Ay.  pair(i,2/))) 

RclceiTJ  =  (0,Aa;.  first(2;)) 

iZelcdr]  =  (0,Aa;.  second(z)) 

/ijnull]  =  (0,Aa;.(O,  err)) 

RM^nv,  =     RM 

Relxjenvr  =     env^lxj 

Refei  +  €2]envr.     =     (0,err)  /*  same  for  Cj  -  62  and  ei  =  62  */ 

i?e[if  ei  then  62  else  eslenu,.     =     if  Oracle(ei)  then  (Rele2JenVr) 

else  (i2e|e2lent;r) 
Reieie2JenVr     =     {Rele^}enVr)(^2)  {Rele2}env^) 
Rellamhda{x).e}envr     =     {V,  \y.RelejenVr[x  t-^  y]) 

where 

y  =  (0,0)U(        U        (enz,4rI)(i))U(     [J     (        U        P(i)))' 

p  in  en^rl^J)  denotes  that  p  is  an  reference  escape  pair  in  ent;,.|2|, 
pnon-li3t  _  gg^  of  non-hst  type  free  identifiers  in  (lainbda(a;).e),   and 
F''-'^  =  Set  of  Ust  type  free  identifiers  in  (lambda(i).e). 

i?e|letrec  2-1  =  ei; . .  .;a;n  =  e^;  in  e|entv     =     Relejenvl 

where  env^  =  envr[xi  h^  Releijenvl, . .  .,Xn  1— »  i(!e|enle'^i'r] 

Rprlprj     =     Reiprjnullenv^ 

Figure  4.3:  Reference  Escape  Semantic  Functions 
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Figure  4.4:  The  Abstract  Basic  Reference  Escape  Domain 

4.4      Abstract  Reference  Escape  Semantics 

We  present  a  safe  and  computable  abstraction  of  the  exact  reference  escape  semantics  de- 
fined in  the  last  section  that  allows  an  approximation  of  the  exact  reference  escape  behavior 
for  functions  to  be  found  at  compile- time. 

Abstracting  Reference  Escape  Domains 

We  S£ifely  approximate  the  exact  reference  escape  semantics  by  abstracting  the  reference 
escape  semantic  subdomains  for  list  type  expressions,  and  by  approximating  the  reference 
escape  semantic  functions.  For  each  expression,  its  corresponding  value  in  the  abstract  ref- 
erence escape  semantic  domain  tells  us  if  an  interesting  reference  is  definitely  not  contained 
in  the  value  of  the  expression  ("non-reference-escape"),  or  if  an  interesting  reference  may  be 
contained  in  the  value  of  the  expression  ("possible  reference-escape").  The  abstract  basic 
reference  escape  domain  is  shown  in  Figure  4.4.        The  ordering  is  defined  as  follows: 

(0,0)C(l,0)C(l,l)C...C(l,/i) 

The  interpretation  of  the  elements  of  Br  is  defined  as  follows: 

•  (1,  j)  :  An  interesting  reference  may  be  contained  in  the  value  of  the  expression,  and 
if  j  >  1  then  it  is  a  reference  to  the  cons  cell  at  the  bottom  j'''  spine  of  a  list.  (If 
J  =  0  then  the  object  pointed  to  by  the  interesting  reference  is  not  a  cons  cell.) 
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•   (0, 0)  :  No  interesting  reference  is  contained  in  the  value  of  the  expression. 

The  abstraction  of  the  reference  escape  semantic  subdomains  for  list  type  expressions  is 
done  by  representing  lists  as  finite  objects,  i.e.    by  combining  the  escape  pairs  of  all  its 
elements  into  a  single  escape  pair.  The  abstract  reference  escape  semantic  domain  D^  and 
the  domain  Er  of  abstract  reference  escape  environments  are  defined  as  follows: 
jD,     =     y^^r  /*  Abstract  reference  escape  semantic  domain  */ 

T 

Er     =     Id —f  Dr     /*  Domain  of  abstract  reference  escape  envirormients  */ 

The  abstract  reference  escape  subdomain  D^  for  expressions  of  type  r  is  defined  as  follows: 

£)^"'  =  Br  X  {err}  abstract  subdomain  for  integers 

£)bool  _  ^^  X  [err}  abstract  subdomain  for  booleans 

^Ti-<T2  _  Br  'X  [Dl^  — >  Dl'^)  abstract  subdomain  for  functions  of  type  Ti  — >  T2 

£)T  list  _  £jT  abstract  subdomain  for  lists  of  type  r  list 

Abstracting  Reference  Escape  Functions 

The  abstract  reference  escape  semantic  functions  are  defined  as  follows: 

Con  -^  Dr  I*  Abstract  reference  escape  function  for  constants  */ 


p^ 


Exp  -^  Er  —*  Dr  I*  Abstract  reference  escape  function  for  expressions  */ 
Program  -^  Dr  /*  Abstract  reference  escape  function  for  programs  */ 
The  abstract  reference  escape  semantic  functions  are  given  in  Figure  4.5.  The  abstract  value 
of  cons  returns  a  single  reference  escape  pair  that  approximates  a  list  of  reference  escape 
pairs  by  taking  the  least  upper  bound  of  its  two  arguments.  The  car°  denotes  a  car  that  is 
applied  to  a  hst  with  5  spines.  For  each  car  in  a  program,  s  can  be  determined  statically  by 
type  checking.  It  may  be  arbitrary  large,  but  is  fixed  at  compile-time.  The  abstract  value 
of  car  is  defined  as  follows:  car^  takes  a  hst  with  s  spines  as  an  argument,  and  returns  a 
list  with  (s  -  1)  spines  when  s  >  1  or  a  non-hst  object  when  s  =  1.  In  either  case,  the  result 
cannot  contain  an  interesting  reference  pointing  to  the  cons  cells  at  the  bottom  s*^  spine  of 
a  list.  The  abstract  value  of  cdr  just  returns  its  argument,  eniv  is  any  abstract  reference 
escape  environment  in  Er,  and  nullenvr  is  an  abstract  reference  escape  environment  that 
maps  every  identifier  to  the  least  element  of  its  abstract  reference  escape  semantic  domain. 

Safety  and  Termination 

The  safety  of  interpretation  under  the  abstract  reference  escape  semantics  can  be  proved  as 
follows.  Let  u  and  v  be  values  of  an  expression  c  of  type  r  in  the  abstract  reference  escape 


^clc]  =  ((0,0),err),c=  {..., -1,0,1,..., true, false} 

^clnil"  ''''1     =  1,  (  The  bottom  element  in  D;.) 

=  {{0,0),Xx.{x^,^,Xy.xUy)) 

=  ((0,0),A2.cut^(x)) 

where  cut=(2)  =  if  (2(i)(2)  =  s)  then  ((0,0),  Z(2))  else  z 

=  {{0,0),Xx.x) 

=  ((0,0),Ax.((0,0),err)) 


^c|consJ 
^clcar^I 

^cfcdr] 
^clnulll 


R.lcjefiv,  =     R.lcj 

Relxjehvr  =     envrfx] 

Reiei  +  e2JenVr     =     ((0,  0),  err) /*  same  for  ej  -  63  and  ei  =  62  */ 

^elif  ei  then  €2  else  egjent;^     =     (^Jezjent;,)  U  {R^leijeiiv^) 

R,le,e2jenvr  =     (R^le^jefiVr^^)  {Rele2JenVr) 

^e[laiiibda(a;).elenu,     =     {V,\y.R^lejenVr[x  >-^  y]) 

where 

V  =  {0,0)U{\J{env4zj\,))and 

zeF 
F  =  Set  of  free  identifiers  in  (lainbda(z).e). 

^elletrec  zi  =  ei;...;2;„  =  e„;inejent;^      =     R^le\env'^ 

where  efiv'^  =  ehv,\x-^  h-.  ^elcijeni;;, . . .,  z„  h^  J?e[enlen<] 
RprlpT}     =     Re\pr}nullenvr 

Figure  4.5:  Abstract  Reference  Escape  Semantic  Functions 
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domain  Dr  and  the  exact  reference  escape  domain  Dr,  respectively.  Let  n  be  the  number 
of  argimients  that  the  type  t  can  take  before  returning  a  value  of  primitive  type.  We  say 
that  the  abstract  reference  escape  semantic  value  u  is  a  safe  approximation  (with  respect 
to  reference  escape  information)  for  the  exact  reference  escape  semantic  value  v  iff 

(  U  P(l))  E  (NAPi(u,5i,...,3fc))(i)(i) 

pin  NAPi(v,«i,...,t4) 

for  all  ib  <  n  where  Si  is  a  safe  approximation  for  ti  for  all  i  <  k. 

Theorem  4.1  (Safety)  For  any  expression  e,  and  environments  env^  and  efiVr  such  that 
for  all  y,  env^lyj  is  safe  for  envrlyj,  Re[e}enVr  is  safe  (with  respect  to  reference  escape 
information)  for  iEelleJeni;^. 

Proof  :     We  can  prove  by  structural  induction  on  expression  e. 

I.  Base  Case: 

1.  e  =  c:  Relcjefiv^  =  R^lcj  and  RelcjenVr  =  Rdcj.  For  c  G  {...,-1,0,1,...,  true, 
false,  nil,  null  }  ,  Rdcj  =  Rdc]  and  thus  it  clearly  holds.  For  c  =  cons,  it  holds 
because  if  xi  and  X2  are  safe  for  yi  and  7/2,  respectively,  then  Xi  U  X2  is  also  safe  for  a  list 
consisting  of  t/i  and  j/2-  It  holds  for  c  =  car^,  because  if  x  is  safe  for  y  then  cut^(x)  is 
safe  for    first(j/).   It  holds  for  c  =  cdr,  because  if  x  is  safe  for  y  then  x  is  clearly  safe  for 

second(z/). 

2.  e  =  x:  Rdxlehvr  =  enUrfzl  and  Rd^jenv^  —  envr\x\.  Since,  for  all  3/,  ent;r|j/]  is 
safe  for  enurfy],  it  clearly  holds. 

II.  Structural  Induction  Step:  Assimie  that  i2e|e|ent;r  is  Scife  for  Rd^\envr  for  expres- 
sions such  as  601^1,62,63  and  e„.  (structural  induction  hypothesis)  Then,  we  show  that 
i?e|e]eniv  is  safe  for  i?e|ejeniir  for  e\  +  62,  if  e\  then  £2  else  63,  e  =  6162,  lainbda(x).ei 
and  letrec  x^  —  e^ ; . . . ;  z"„  =  £„;  in  e^.  This  can  be  proved  in  the  same  way  as  the  safety 
proof  of  the  abstract  escape  semantics  with  respect  to  the  exact  escape  semantics,  n 

Theorem  4.2  (Termination)  For  any  (finite)  program  pr  6  Program,  i?pr|pr|  is  com- 
putable. 

Proof  :  Every  functional  in  the  reference  escape  domain  that  is  defined  by  the  abstract 
reference  escape  semantic  functions  is  composed  of  the  operators  such  as  the  least  upper 
bound  operator  U  and  cut^,  which  are  all  monotonic.  As  before,  each  subdomain  Z?^  is 
finite.  □ 
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4.5      Reference  Escapement  Testing 

Reference  escape  analysis  will  determine  for  a  function  the  relative  lifetime  of  the  reference 
associated  with  a  bound  variable  with  respect  to  references  associated  with  its  occurrences. 
We  perform  reference  escape  analysis  on  each  occurrence  of  each  argument  of  a  fimction 
call  separately.  Thus,  at  any  time  we  are  only  interested  in  whether  or  not  a  particular 
single  occurrence  of  a  particular  variable  escapes.  Other  objects  may  escape  in  the  result  of 
a  function  call,  but  are  ignored  by  our  analysis  model.  An  occurrence  is  interesting  if  it  is 
the  one  whose  escape  behavior  we  are  trying  to  determine.  If  a  variable  has  n  occurrences, 
then  reference  escape  analysis  will  be  performed  n  times,  each  time  treating  a  different 
occurrence  as  interesting. 

Consider  the  example  from  before: 

f   X   y   =      letrec   g   a  b  =    cons   a  b 
in   cons   x    (g  x   y) 

As  we  discussed  previously,  each  occurrence  of  x  in  the  body  of  f  denotes  the  creation  of 
a  new  reference.  To  differentiate  between  the  occurrences  of  x,  we  label  each  occurrence 
differently.  In  fact,  the  different  occurrences  can  be  considered  different  parameters  to  the 
auxiliary  function  derived  from  f : 

f    xl   x2   y   =      letrec  g   a  b   =   cons    a  b 
in   cons   xl    (g  x2   y) 

Our  abstract  reference  escape  semantics  will  give  the  escapement  of  the  parameters  to  f ' , 
and  thus  of  the  references  corresponding  to  xl  and  x2.  We  describe  below  how  this  analysis 
proceeds. 

Global  Reference  Escape  Test 

Given  a  function  f  x^  x^  ■  ■  ■  Xn  =  bodyf  of  arity  n,  the  position  (z,  j)  of  an  interest- 
ing reference  of  a  parameter,  and  an  abstract  reference  escape  semantic  enviroimient  eiivr 
mapping  /  to  an  element  of  D^,  the  global  reference  escape  test  function  G_refescape?  de- 
termines whether  the  reference  associated  with  the  j""  occurrence  of  the  i'''  parameter  of  / 
could  escape  /  globally.  It  is  defined  as  follows: 

G-refescape?(/,  i,_/,  enVr)  = 

{Relf  X]   ...  a;i„(i)  ...  s„   ...  2„o(n)I  ent^r[/'^  /',a:,j  I-  2/,j])(i)(i) 
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where  /'  is  the  auxiliary  function  for  /, 

/'  =  Relf'jenv,, 

yij  =  ((1,5,),  W^'),  I*  The  j"*  occurrence  of  i"'  parameter  is  interesting  */ 

5,  is  the  number  of  spines  of  the  i""  parameter  of  /  (if  it  is  a  list  type,  otherwise  5^  is  0), 
for  all  k  <  o[i)  and  k  ^  j, 

2/ifc  =  ((0,0),  VF'^'),  /*  Other  occurrences  of  z'"*  parameter  are  not  interesting  */ 

and  for  all  1  <  m  <  o[l)  and  /  7^  i, 

j/;^  =  ((0,0),  VF'^'),  /*  Occurrences  of  other  parameters  are  not  interesting  */ 

and  T,  is  the  type  of  the  z""  parameter  of  /.  Ordy  the  reference  associated  with  the  j"*  occur- 
rence of  the  i"'  parameter  is  interesting  reference,  and  the  references  associated  with  other 
occurrences  of  the  i""  parameter  are  not  interesting.  Similarly,  the  references  associated 
with  all  occurrences  of  parameters  other  than  the  f""  parameter  are  also  not  interesting.  In 
order  to  represent  the  functional  behavior  of  all  possible  expressions  that  could  be  the  i"* 
argument  to  /,  the  worst-case  behavior  is  taken.  From  the  result  of  the  global  reference 
escape  test  function,  we  can  conclude  the  following: 

•  If  G_refescape?(/,  z,y,  entir)  =  0  then  we  conclude  that  the  reference  associated  with 
the  j""  occurrence  of  the  i"'  argument  does  not  escape  the  function  call  to  /  in  any 
possible  application  of  /  to  n  arguments. 

•  If  G_refescape?(/,  z,j,  efit^r )  =  1  then  it  means  that  the  reference  associated  with  the 
j'''  occurrence  of  the  z  argument  could  escape  the  function  call  in  some  possible 
application  of  /  to  n  arguments. 

Local  Reference  Escape  Test 

Given  a  function  f  X\  X2  ■  ■  ■  Xr,  =  bodyj  of  arity  n  in  a  particular  function  application 
/  ej  . . .  Gn,  the  position  {i,j)  of  an  interesting  reference  of  a  parameter,  and  an  abstract 
reference  escape  semantic  environment  eniv  mapping  /  and  free  identifiers  within  e^  through 
c„  to  elements  of  D^,  the  global  reference  escape  test  function  L_refescape?  determines 
whether  the  reference  associated  with  the  j  occurrence  of  the  i'''  parameter  of  /  could 
escape  /  globally.  It  is  defined  as  follows: 
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L-refescape?(/,  i,;,  ei,...,en,ent;r)  = 

{Relf  Xi    ...    Iio(i)    ...    Xr,    ...    Z„o(n)I  enVr[f'  ^  /',  Z,j   H->  y,j])(i)(i) 

where  /'  is  the  auxiliary  function  for  /, 

/'  =  Relfjenvr, 

Vij  =  ((Ii5i),(-Re[e.-Ienv^)(2)), 

Si  is  the  number  of  spines  of  the  i""  parameter  of  /  (if  it  is  a  list  type,  otherwise  5,  is  0), 
for  all  A;  <  o{i)  and  k  7^  j, 

y,k  =  {{0,0),{ReleijenVr)^2)), 
for  all  1  <  m  <  o{l)  and  /  /  i, 

yim  =  ((0,0),(^eMen7;,)(2)). 
Then,  from  the  result  of  the  local  reference  escape  test  function,  we  can  conclude  as  follows: 

•  If  L_refescape?(/,  i,j,  ej, . . .,  e^,  ehvr)  =  0  then  we  conclude  that  the  reference  associ- 
ated with  the  j"*  occurrence  of  the  i^^  argvunent  does  not  escape  the  function  caill  to 

/  in  (/  ei  ...  e„). 

•  If  L_refescape?(/,  i,j,  ei, . . .,  e^,  enVr)  =  1  then  it  means  that  the  reference  associated 
with  the  y*  occurrence  of  the  i'^  argument  could  escape  the  function  call  (/  Ci  . . .  e^). 

Examples 

As  an  example,  consider  a  program  defined  as  follows: 

letrec  map  f  1  =  if  (null  1)  then  nil 

else  cons  (f  (car  1))  (map  f  (cdr  1)); 

sum  1  =  if  (null  1)  then  0 

else  (car  1)  +  sum  (cdr  1); 

addsum  x  y  =  cons  x  (cons  y  (cons 

(map  (leimbda(z)  .  (sum  y)  +  z)  x)  nil)); 
in  .  .  . 

We  assmne  that  the  type  of  each  function  is  given  by 

86 


map  :  {int  — >  int)  — ♦  int  list  — >  int  list 

sum  :  int  list  -^  int 

addsum  :  int  list  —>  int  list  — »  {int  list)list 

From  type  checking,  each  car  in  the  program  can  be  annotated  as  follows: 

map  f  1   =   if    (null  1)   then  nil 

else  cons    (f    (CARl   1))    (map  f    (cdr  1)); 

sum  1  =   if    (null  1)   then  0 

else    (CARl   1)   +   sum  (cdr  1); 

where  CARi  denotes  a  car  that  takes  as  its  argimient  a  list  with  i  spines.  The  definitions 
of  the  reference  escape  semantic  values  of  map,  sum,  and  addsum  are  as  follows: 

mapfl  =     ((0,0),err-)  U(/(2)(cuti(/(i)),/(2)>)U((map(2)/)(2)/) 

sum  I  =     ((0, 0),  err)  U  ((0,0),  err) 

addsum  X  y     =     a;  U  j/  U  ((map(2)  (2/(1),  Az.((0,  0),err)))(2)  x) 

Since  map  is  defined  recursively,  the  meaning  of  map  is  found  by  a  fbcpoint  iteration: 

map^°'>  f  I     =     ((0,0), err) 

map(^)fl     =     ((0,0),err)u(/(2)(cuti(/(i)),/(2)))U  ((mapj;j/)(2)/) 

=       /(2)   (cutl(/(i)),/(2)) 

map^')fl     =     ((0,0),err)u(/(2)(cuti(/(i)),/(2)))U  ((map|;j/)(2)/) 

=       /(2)   (cutl(/(i)),/(2)) 

Since  m.ap^^'  =  map^^\  we  have  that 

map=((0,0),A/.(/(i),A/./(2)(cuti(/(ij),/(2)))) 

addsumxy     =  a;  U  y  U  ((map(2)  (j/(i),  A2.((0,  0),err)))(2)  a;) 

=  xUy  U(A2.((0,0), err))  (cuti(a;(i)),X(2)) 

=  xUy  U   ((0,0),  err) 

=  xUy 

The  auxiliary  functions  map'  and  addsum'  for  map  and  addsum  are  defined  as  follows: 

map'    fl   f2   11   12   13   =   if    (ll=nil)    then  nil 

else    cons    (fl    (car   12)) 

(map  f2    (cdr   13)); 


addsiim'    xl   x2  yl   y2  =   cons   xl    (cons   yl 

(cons    (map    ( lambda (z)  .  (siim  y2)+z)    x2)    nil)); 

Note  that  map'  is  not  recursively  defined.  The  definitions  of  the  reference  escape  semantic 
values  of  map',  and  addsum'  are  given  as  follows  (without  a  fixpoint  iteration): 

map'  /I  /2  /I  12  13     =     ((0,  0),  err)  U  (fl^^)  (cutV/2(i)),  /2(2)))  U  {{map^^)  /2)(2)  /3) 
=     {(0,0),e7T)u(/l(2)(cuti(/2(i)),/2(2))) 
U(/2(2)(cuti(/3(i)),/3(2))) 

addsum' xl  x2  yl  y2   =   xlUyl 

Let  enVr  =  [map  i— ♦  map,  add  >— >  add,  addsum  i— »  addsum].  Then, 

G.refescape?(addsum,  1, 1,  enVr)     =     (iZel^^dsum'    xl    x2   yl    y2]eni;'r)(i)(i) 

=     1 

where  env'r  =  eniv[addsum'  i— »  addsum',  xl  i— ►  ((1,  1),  err),  x2,  yl,  y2  h-»  ((0,  0),  err)]. 
Thus,  we  can  conclude  that  the  reference  associated  with  the  first  occurrence  xl  of  the 
first  parameter  x  of  addsum  escapes.  And, 

G_refescape?(addsum,  1,  2,  enVr)     =     (iZeffa-ddsum'    xl    x2   yl    y2]enf'r){i)(i) 

=     0 

where  env'^  =  eni^ [addsum'  i— >  addsum.', x2  i— ►  ((1, 1), err), xl,yl,y2  >—>  {{0,0), err)]. 
Thus,  we  can  conclude  that  the  reference  associated  with  the  second  occurrence  x2  of 
the  first  parameter  x  of  addsiun  does  not  escape. 

G-refescape?(addsum,  2, 1,  eniv)     =     (/?eladdsum'    xl    x2   yl    y2|env'r)(i)(i) 

=     1 

where  env'r  —  envr[addsum'  h-'  addsum',  yl  *-^  ((1, 1),  err),  xl.  x2.y2  ^-»  {{0,0),  err)]. 

G_refescape?(addsum,  2,  2,  ent;^)     =     (i?e[addsum'    xl    x2   yl   y2je7«i;'r  )(i)(i) 

=     0 

where  env'r  =  eniv[addsum'  >-^  addsum',  y2  >—>  ((1, 1),  err),  xl,x2,  yl,  i— »  ((0,  0),  err)]. 
Thus,  similarly,  we  can  conclude  that  the  reference  associated  with  the  first  occurrence  yl 
of  the  second  parameter  y  of  addsum  escapes,  but  the  reference  associated  with  the  second 
occurrence  y2  of  the  second  parameter  y  of  addsum  does  not  escape. 
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G_refescape?(inap,  l,l,eni;,)     =     (^efmap'    fl   f2   11    12   13lenv',)(i)(i) 

=     0 


where 


and 


env'r  -  enz;r[map'  i->  map',  fl  h->  ((1,  0),  Az.(2(i),  err-)), 

f  2  ^  ((0,  0),  A2.(r(i),  err)),  11, 12, 13  ^  {(0,  0),  err)]. 


G_refescape?(map,  l,2,eni;,.)     =     (^e[map'    fl   f2   11    12   13leni;V)(i)(i) 

=     0 

where 

env'^.  —  ent;r[niap'  i-^  Tnap\il  h->  ((0,0),  A2.(r(i),  err)), 

f2^  ((l,0),A2.(2(i),  err)), 11, 12,13^  ((0,  0),  err)]. 

In  the  same  way,  we  also  can  conclude  that  the  references  associated  with  the  occurrences 
f  1 ,   f  2  of  the  first  parameter  f  of  map  do  not  escape. 

4.6      Improving  Precision  of  Reference  Escapement 

We  present  a  method  of  improving  the  precision  of  reference  escape  information  that  is 
obtainable  through  the  reference  escape  analysis  by  using  position  information  about  inter- 
esting references  in  a  list  structure.  We  describe  another  safe  and  computable  abstraction 
of  the  exact  reference  escape  semantics  that  gives  more  precise  information  about  refer- 
ence escapement.  The  basic  inaproved  abstract  reference  escape  domain  is  constructed  by 
extending  the  basic  reference  escape  domain  to  include  additional  information  about  both 
spine  level  and  position.  We  safely  approximate  the  exact  reference  escape  semantics  by 
abstracting  the  reference  escape  semantic  subdomains  for  list  type  expressions,  and  by 
approximating  reference  escape  semantic  functions.  Abstraction  of  the  reference  escape  se- 
mantic subdomains  for  list  type  expressions  is  done  by  representing  lists  as  finite  objects, 
i.e.  by  combining  the  reference  escape  pairs  of  all  its  elements  into  a  single  reference  escape 
pair. 

For  each  expression,  its  corresponding  value  in  the  improved  abstract  reference  escape 
domain  tells  us  if  an  interesting  reference  is  definitely  not  contained  in  the  value  of  the 
expression  ("non-reference-escape"),  or  if  an  interesting  reference  may  be  contained  at  some 
position  in  the  value  of  the  expression  ("possible  reference-escape  and  where").   The  basic 
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(l,h,0) 


(l,h,p-l) 
(l,h,p) 
(1,0,0) 


(l,0,p-l) 
(1,0,  p) 
(0,0,0) 

Figure  4.6:  The  Improved  Abstract  Basic  Reference  Escape  Domain 
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improved  abstract  reference  escape  domain,  Br,  for  some  fixed  p  is  shown  in  Figure  4.6. 
The  ordering  is  defined  as  follows: 

(0,0,0)  c(i,o,p)c  {i,o,p-i)n...c{i,o,o)...{i,h,p)c{i,h,p-i)n...n{i,h,o) 

The  interpretation  of  the  elements  of  B^  is  defined  as  foUows: 

•  {l,j,k)  :  An  interesting  reference  may  be  contained  in  the  value  of  the  expression, 
cind  if  i  >  1  then  it  is  a  reference  to  a  cons  cell  at  the  bottom  j  spine  of  a  list  and  it 
may  occur  only  at  >  A;  position.  (If  j  =  0  then  the  object  pointed  by  the  interesting 
reference  is  not  a  cons  cell.) 

•  (0,0,0)  :  No  interesting  reference  is  contained  in  the  value  of  the  expression. 

The  improved  abstract  reference  escape  semantic  domain  Dr  and  the  domain  E^  of 
improved  abstract  reference  escape  environments  are  defined  as  follows: 

Dr     =     Ylr  ^l         I*  Improved  abstract  reference  escape  semantic  domain  */ 
Er     =     Id  ^>  Dr     /*  Domain  of  improved  reference  escape  enviroimients  */ 

The  improved  abstract  reference  escape  subdomain  D^  for  expressions  of  type  r  is  defined 
as  foUows: 

Z'J."'  =  5r  X  {err}  improved  abstract  subdomain  for  integers 

£)bool  _  ^^  X  {err}  improved  abstract  subdomain  for  booleans 

£)Ti—T2  _  ^^  X  (Dr^  — >  Dr^)  improved  abstract  subdomain  for  functions 

£fT  hst  _  £)T  improved  abstract  subdomain  for  lists 

The  abstract  reference  escape  semantic  functions  are  defined  as  follows: 


Re 

Re 

Rpr 


Con  —*  Dr  /*  Improved  semantic  function  for  constants  */ 

Exp  —*  Er  ^>  Dr     /*  Improved  semantic  function  for  expressions  */ 
Program  ^  Dr       /*  Improved  semantic  function  for  programs  */ 


The  improved  abstract  reference  escape  semantic  function  R^  :  Con  -^  Dr  that  gives 
reference  escape  meaning  to  constants  is  given  in  Figure  4.7.  The  improved  abstract  value  of 
cons  takes  two  arguments,  and  returns  an  improved  reference  escape  pair  of  their  least  upper 
bound  by  updating  the  position  information  of  any  interesting  reference  in  the  resulting  list. 
The  improved  abstract  value  of  car^  returns  its  argument  according  to  the  position  of  any 
interesting  object,  car^  takes  a  list  with  s  spines  and  returns  the  element  that  was  in  the 
0'  '  position  and  has  (s  -  1)  spines.  Thus,  the  result  cannot  contain  an  interesting  reference 
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-^cW  =     ((0,0, 0),err),    c  G  {...,-1,0,1, ...,true,false} 

^4nir '"'1     =     U  (  The  bottom  element  in  I);.) 

^clconsl     =     ((0,0,0),A2:.(i(i),Ay.ipush(2,y))) 
where 
ipush(z,  y)  =     if  (2:(i)(i)  =  1)  then 

((1.  a;(i)(2)  U  2/(i)(2),  0),  X(2)  U  y(2)) 
elseif  (3/(i)(i)  =  1)  then 

((1,  y(i)(2),  min(2/(i)(3)  +  l,p)),  i(2)  U  y(2)) 
else  ((0,0,0),X(2)Uy(2)) 
^Jcar^I     =     ((0,0,0),Aa;.icut=(i)) 
where 

icut"(2)  =     if  (5  <  2(i)(2))   or   (2(i)(3)  >  0)  then  ((0,  0,  0),  2(2)) 
else  z 
^clcdrl       =     ((0,0,0),Ax.rrest(i)) 
where 
rrest(2)  =     ((2(i)(i),  2(i)(2),max[2(i)(3)  -  1,0]),  2(2)) 
^elnulll     =     ((0,0,0),Ax.((0,0,0),er7-)) 

FigTire  4.7:  Improved  Abstract  Reference  Escape  Semantic  Function 
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pointing  to  a  cons  cell  at  the  bottom  s""  spine  of  a  list  or  that  occurred  at  a  position  >  1  in 
the  original  list.  The  improved  abstract  value  of  cdr  also  updates  the  position  information 
appropriately.  Note  that  the  improved  abstract  reference  escape  semantic  function  .Re  for 
cons,  car  and  cdr  provides  more  precise  escape  information  than  the  abstract  reference 
escape  semantic  function  Re- 

The  improved  abstract  reference  escape  semantic  functions  R^  and  Rp^  are  defined 
identically  to  .Re  and  Rpr^  respectively  -  except  for  their  value  in  the  basic  domain. 

Let  u  and  v  be  values  of  an  expression  e  of  type  t  in  the  improved  abstract  reference 
escape  domain  D-r  and  the  exact  reference  escape  domain  D^,  respectively.  Let  n  be  the 
nimiber  of  arguments  that  the  type  t  can  take  before  returning  a  value  of  primitive  type. 
We  say  that  the  improved  abstract  reference  escape  semantic  value  u  is  a  safe  approximation 
of  the  exact  reference  escape  semantic  value  v  iff 

(  U  P(l))   E  (NAPfc(u,5i,...,5fc))(i)(i) 

pinNAPi(u,ti,...,tjt) 


[MINp  in  NAPt(«,(j,  ..,(i)&p,,,  =  iPosition  of  p)  >  (NAPfc(u,  Sj, . . . ,  Sk))(i)(^3) 
for  all  k  <  n  where  Si  is  a  safe  approximation  for  <,  for  all  i  <  k. 

Theorem  4.3  (Safety)  For  any  expression  e,  and  environments  env^  and  efiVr  such  that 
for  all  y,  efivj-lyj  is  safe  for  env^fyj,  R^le^ehVr  is  safe  (with  respect  to  reference  escape 
information)  for  iZefeJeniir- 

Proof  :     We  can  prove  by  structural  induction  on  expression  e. 
L  Base  Case: 

1.  e  =  c:  Relcjenvr  =  Rdcj  and  R^cjenVr  =  Rcfcj.  For  cG  {....-1,0,1....,  true, 
false,  nil,  null  }  ,  Rdc}  =  Rdcj  and  thus  it  clearly  holds.  For  c  =  cons,  it  holds 
because  if  ii  and  X2  are  safe  for  j/i  and  j/2>  respectively,  then  ipush(a;(i),  12)  is  also  safe  for 
a  list  consisting  of  yi  and  2/2 ■  It  holds  for  c  =  car^,  because  if  x  is  safe  for  y  then  icut^(2;) 
is  safe  for    first(i/).  It  holds  for  c  =  cdr^,  because  if  x  is  safe  for  y  then  rrest(s)  is  safe  for 

second(3/). 

2.  e  =  x:  Relxjenvr  =  envrlxj  and  RelxjenVr  =  envrlxj.  Since,  for  all  y,  envdyj  is 
safe  for  enVrlj/J,  it  clearly  holds. 

II.  Structural  Induction  Step:  Assume  that  RglejefiVr  is  safe  for  Rdejenv^  for  expres- 
sions such  as  60,61,62,63  and  en.    (structural  induction  hypothesis)  Then,  we  show  that 
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Figure  4.8:  Relationship  among  Reference  Escape  Semantics 

Rele}ehvr  is  safe  for  RelelenVr  for  ei  +  63,  if  ei  then  62  else  63,  e  =  6162,  lainbda(2;).ei 
and  letrec  Zj  =  cj; . . . ;  z„  =  e^;  in  cq-  This  can  be  proved  in  an  exactly  same  way  as  the 
proof  of  safety  of  the  abstract  reference  escape  semantics.  □ 

Theorem  4.4  (Termination)  For  any  (finite)  program  pr  £  Program,  iZpr([pr|  is  com- 
putable, I.e.  always  terminates  infinite  number  of  steps. 

Proof  :  Every  functional  in  the  improved  reference  escape  domain  that  is  defined  via 
the  abstract  improved  extended  escape  semantic  functions  is  composed  of  the  operators 
such  as  the  least  upper  bound  operator  U,  ipush,  icut^,  and  rrest.  ipush^,  icut^  and  rrest 
are  monotonic  operators.  Since  the  composition  of  monotonic  functions  is  also  monotonic, 
every  functional  is  monotonic.  □ 

Theorem  4.5  (Precision  Improvement)    The  abstract  reference  escape  semantics  ts  equiv- 
alent (with  respect  to  their  reference  escapement  information  content)  to  the  improved  ab- 
stract reference  escape  semantics  with  p  =  0.    Thus,  the  improved  abstract  reference  escape 
semantics  with  some  p  >   0  provides  more  precise  escape  information  than  the  abstract 
reference  escape  semantics. 

Proof  :  This  can  be  proved  in  the  similar  way  to  the  proof  of  Theorem  2.5.  □ 

The  relationship  among  the  standard  semantics  (55),  the  non-standard  exact  reference 
escape  semantics  (RS),  the  abstract  reference  escape  semantics  (ARS)  and  the  improved 
abstract  reference  escape  semantics  (lARS)  is  shown  in  Figure  4.8. 
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Improved  Global  Reference  Escape  Test 

Given  a  function  f  Xi  X2  . . .  x^  =  hodyj  of  arity  n,  the  position  (i,j)  of  an  interesting 
reference  of  a  parameter,  and  an  improved  abstract  reference  escape  semantic  environment 
envr  mapping  /  to  an  element  of  Dr,  the  improved  global  reference  escape  test  function 
GJrefescape?  which  determines  whether  the  reference  associated  with  the  j"*  occurrence  of 
the  i""  parameter  of  /  could  escape  /  globally  is  defined  as  follows: 

G-irefescape?(/,  i,  J,  enwr)  = 

[R^lf  Xi    ...    a;i„(i)    ...    Xr,    ...    2;no(n)l  enVr[f'  ^   /',  Xij  ^  yij])(l)(l) 

where  /'  is  the  auxiliary  function  for  /, 

/'  =  RAflehv,. 

rjij  =  ((1,5,,  0),  VK"^'),  /*  The  j'"*  occurrences  of  i""  parameter  is  interesting  */ 

s,  is  the  number  of  spines  of  the  f""  parameter  of  /  (if  it  is  a  Ust  type,  otherwise  Si  is  0), 
for  all  A;  <  o{i)  and  k  ^  j, 

y^f;  =  ((0,0,0),  W'),  /*  Other  occurrences  off*''  parameter  are  not  interesting  */ 

for  all  1  <  m  <  o[l)  and  /  /  i, 

yim  =  ((0,  0,0),  U'"'"'),  /*  Occurrences  of  other  parameters  are  not  interesting  */ 

and  r,  is  the  type  of  the  z'""  parameter  of  /.  The  result  of  the  global  improved  reference 
escape  test  function  is  interpreted  as  follows: 

•  If  GJrefescape?  (/,  i,j,  envr)  =  0  then  we  can  conclude  that  the  reference  associated 
with  the  j'''  occurrence  of  the  j  argument  does  not  escape  the  function  call  to  /  in 
any  possible  application  of  /  to  n  arguments. 

•  If  G_irefescape?(/,z,_/,  envr)  =  1  then  the  reference  associated  with  the  j^^  occiu-rence 
of  the  i""  argument  could  escape  the  function  call  to  /  in  some  possible  application  of 
f  to  n  arguments. 

Improved  Local  Reference  Escape  Test 

Given  a  function  f  Xi  X2  ■  ■  ■  x„  =  bodyj  of  arity  n  in  a  particular  function  application 
/  ej  ...  Cn,  the  position  (t,j)  of  an  interesting  reference  of  a  parameter,  and  an  improved 
abstract  reference  escape  semantic  environment  envr  mapping  /  and  the  free  identifiers 
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within  ei  through  e^  to  elements  of  Dr,  the  improved  global  reference  escape  test  function 
LJrefescape?  which  determines  whether  the  reference  associated  with  the  j"*  occurrence  of 
the  2"'  parameter  of  /  could  escape  /  locally  is  defined  as  follows: 

LJrefescape?(/,  i,;,  Cj, . . . ,  e„,  ehvr)  - 

[Relf  x^   ...  xi„(i)  ...  Xr,  ...  a:„o(„)l  envrlf  ^  f',Xij  H^  2/,j])(i)(i) 

where  /'  is  the  auxiliary  function  for  /, 

/'  =  Relf'hriv^, 

y,j  =  ((l,5„0),(^e[e,Ient;,)(2)), 

Si  is  the  number  of  spines  of  the  z""  parameter  of  /  (if  it  is  a  list  type,  otherwise  3,  is  0), 
for  all  A:  <  o{i)  and  k  /  j, 

y,k  =  ((0,0,0),(^eIe,Jen^O(2)), 
for  all  1  <  m  <  o{l)  and  /  7^  i, 

2/i„.  =  {(0,0,0),  (^e[e/leni;0(2)). 
The  result  of  the  local  improved  reference  escape  test  function  is  interpreted  as  follows: 

•  If  Ljrefescape?(/,i,  j,  ei, . .  . ,  Cn,  ent^r)  =  0  then  we  can  conclude  that  the  reference 
associated  with  the  j""  occurrence  of  the  i'^  argument  does  not  escape  /  locally  in 
(/ei  ...  e„). 

•  If  L_irefescape?(/,  z,  j,ei, . . .,  en,envr)  =  1  then  it  means  that  the  reference  associated 
with  the  j""  occurrence  of  the  z""  argument  could  escape  /  locally  in  (/  C]  . . .  e„). 

4.7      Complexity  of  Reference  Escape  Analysis 

'1  he  abstract  interpretation  framework  for  the  reference  escape  analysis  that  deals  with 
higher-order  functional  languages  with  non-flat  domains  is  very  similar  to  the  framework 
for  strictness  analysis  for  higher-order  functional  languages  with  non-flat  domains.  Both 
analyses  use  a  /;-element  domain  where  k  is  fixed  and  greater  than  2  as  their  basic  abstract 
domains,  respectively.  Like  any  other  analysis  based  on  abstract  interpretation,  the  major 
complexity  of  our  analysis  comes  from  finding  the  fLxpoints  of  recursive  functions  in  the 
abstract  semantic  domains.    In  our  analysis,  the  reference  escape  testing  is  performed  on 
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each  reference  associated  with  each  occurrence  of  a  parameter  of  a  function  separately  using 
its  auxiliary  function.  However,  since  the  auxiliary  function  for  a  function  is  never  recursive 
even  if  the  original  function  is  a  recxu-sive  function,  the  process  of  finding  a  fixpoint  is  needed 
only  for  an  original  function,  but  is  never  needed  for  its  auxiliary  function.  Thus,  the  order 
of  time  complexity  of  reference  escape  analysis  is  the  same  as  that  of  strictness  analysis  for 
higher-order  languages  with  non-flat  domains,  which  is  exponential. 


Chapter  5 


Order-of-Demand  Analysis 


In  lazy  evaluation,  argmnents  to  a  function  cire  not  evaluated  unless  amd  until  their  values  are 
demanded,  and  are  evaluated  only  once  upon  the  first  demand.  Their  values  are  then  saved 
to  be  used  for  subsequent  demands,  thus  avoiding  reevaluation.  Exact  information  about 
the  strictness  of  argmnents,  the  order  of  evciluation  among  arguments,  and  the  evaluation 
status  of  argmnents  wrhen  demanded  is  generally  imknown  at  compile-time.  If  inferred 
at  compile-time,  such  information  can  be  useful  for  a  nimiber  of  optimizations  for  lazy 
evaluation. 

In  this  chapter,  we  present  a  method  for  statically  inferring  a  range  of  information 
including  strictness,  evaluation-order,  and  evaluation-status  information  in  a  higher-order, 
monomorphic,  non-strict  functional  language  with  lazy  evaluation.  This  method  is  based 
on  a  compile-time  analysis  called  order- of- demand  analysis  which  provides  safe  information 
about  the  order  in  which  the  values  of  bound  variables  are  demanded.  First,  we  introduce  a 
non-standard  denotational  semantics  called  before  semantics  that  describes  the  actual  order- 
of-demand  behavior,  but  is  incomputable  at  compile-time.  A  method  of  approximating  the 
exact  before  semantics  which  is  safe  with  respect  to  the  exact  before  semantics  and  is 
computable  at  compile-time  is  then  presented.  Based  on  this  abstract  before  semantics, 
we  describe  algorithms  which  determine  order-of-demand  information  and  the  complexity 
of  the  order-of-demand  analysis.  Finally,  extensions  of  the  order-of-demand  analysis  to 
a  parallel  lazy  evaluation  model,  to  an  optimized  lazy  evaluation  model  using  strictness 
information,  and  to  non-flat  domains  are  discussed. 
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5.1      Order  of  Demand  under  Lazy  Evaluation 

We  present  a  method  for  detecting  at  compile-time  a  range  of  information  including  strict- 
ness, evaluation-order,  and  evaluation-status  information  in  a  higher-order  functional  lan- 
guage being  implemented  using  lazy  evaluation.  The  range  of  information  can  be  reformu- 
lated in  terms  of  information  on  order  of  demand  as  follows: 

•  Evaluation  Status:  Given  an  occurrence  s,  of  a  variable  2;  in  the  body  of  a  function 
/,  for  each  possible  execution  of  the  body  of  / 

—  If  there  exists  another  occurrence  Xj  of  a;  such  that  Xj  is  demanded  before  Xi 
(may  be  several  ij's  in  different  paths),  then  we  know  that  x  must  have  been 
evaluated  by  the  time  x,  is  encountered. 

—  If  there  exists  no  occurrence  Xj  of  x  such  that  Xj  is  demanded  before  a;,,  then  we 
know  that  a;  must  have  not  been  evaluated  by  the  time  Xi  is  encountered. 

•  Parameter  Evaluation  Order.  Given  two  parameters  x  and  y  of  a  fuinction  /,  if  for 
every  occurrence  ?/,  of  y  in  the  body  of  /  there  exists  an  occurrence  Xj  of  x  that  is 
demanded  before  y,,  then  we  can  conclude  that  x  wiU  always  be  evaluated  before  y. 

•  Strictness:  Given  a  parameter  a;  of  a  function  /,  and  an  imaginary  variable  $  which 
is  demanded  just  after  the  call  to  /  is  evaluated,  if  for  each  possible  (terminating) 
execution  of  the  body  of  /  some  occurrence  a;,  of  x  was  demanded  before  $,  then  /  is 
strict  with  respect  to  x. 

Consider,  for  example,  the  following  function: 

f   w   X   y   z   =    if   w=0   then  z+x   elseif    y=0   then  z+x 
else    (z+y)    +   f    (w-1)    x    (y-1)    z 

We  assiune  that  the  primitive  functions  such  as  + ,  - ,  =  evaluate  their  arguments  in  left- 
to-right  order.  For  convenience,  we  represent  each  occurrence  of  a  f's  bound  variable  as  a 
distinct  variable  as  follows: 

=   if   wl=0   then  zl+xl   elseif   yl=0   then  z2+x2 
else    (z3+y2)    +   f    (w2-l)    x3    (y3-l)    z4 

Our  order-of-demand  analysis  would  allow  us  to  determine  the  following  properties  of  the 
function  f  at  compile  time: 


99 


•  Evaluation  Status:  When  the  value  of  y  is  demanded  via  y2  and  y3,  respectively,  y 
has  already  been  evaluated.  But,  when  it  is  demanded  via  yl,  y  has  not  yet  been 
evaluated  at  the  point. 

•  Parameter  Evaluation  Order.  The  parameters  to  f  are  evaluated  in  the  order  w,  z  and 

X. 

•  Strictness:  f  is  strict  in  w,  x  and  z,  but  is  not  strict  in  y. 

The  method  is  based  on  a  compile-time  analysis  called  order- oj- demand  analysis  which 
provides  safe  information  about  the  order  in  which  the  values  of  variables  are  demanded. 
Rather  than  try  to  determine  the  relative  order-of- demand  between  all  possible  pairs  of 
occurrences,  it  turns  out  to  be  useful  and  more  efficient  to  define  an  order-of-demand  rela- 
tion between  sets  of  occurrences.  We  define  a  relation  between  two  sets  of  occurrences  of 
parameters  of  a  function  which  specifies  the  order-of-demand  property  between  them. 

Definition  5.1  Given  two  non-empty  disjoint  sets  X  and  Y  of  labeled  occurrences  of  vari- 
ables of  a  function  and  an  expression  e,  we  define  an  order-of-demand  relation  between  X 
and  Y  during  evaluation  of  an  expression  e  (which  contain  the  occurrences)  as  follows: 

•  Y  -<  X ,  pronounced  Y  before  X,  if  for  each  occurrence  x  £  X,  either  there  exists 
an  occurrence  y  G  1"  that  is  demanded  before  x  or  x  is  not  demanded  during  the 
evaluation  of  e. 

•  If  i'  ■<  X  holds  for  any  possible  application  of  /  to  n  arguments  then  we  say  that 
Y  -<  X  globally.  If  Y  -<  X  holds  for  a  function  application  of  /  to  some  particular  n 
arguments  then  we  say  that  Y  ^  X  locally. 

For  example,  some  properties  of  <  among  occurrences  of  variables  in  f  given  above  are: 

•  {  yl.yS  }  ^  {  y2  },  {  yl,y2  }  ^  {  y3  },  and  {  y2.y3  }  /  {  yl  }• 

•  {  wl,w2  }  ^  {  Zl,z2,z3,z4  }  and  {  zl,z2,z3,z4  }  •<:  {  xl,x2,x3  }. 

•  {  wl,w2  }  -<  {  S  },  {  xl,x2.x3  }  -^  {  $  },  {  zl,z2.z3,z4  }  ^  {  $  },  and  {  yl,y2,y3 
}  7^  {  $  }  where  $  denotes  an  occurrence  of  an  imaginary  variable  that  is  demanded 
after  (f   w  x  y  z)  is  evaluated. 

The  order-of-demand  analysis  described  here  answers  the  following  question:  Given  a 
function  and  two  sets  X  and  Y  of  occurrences  of  the  function's  bound  variables,  which 
of  the  following  relations  holds,  if  any  :    Y   <   X  or  A'    -;   Y .    We  will  develop  a  method 
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for  a  higher-order,  monomorphic,  non-strict  functional  language  to  answer  the  following 
questions  at  compile-time: 

•  Given  a  function,  what  is  the  order  of  demand  between  the  parameters  or  locally 
defined  objects  within  the  function,  globally? 

•  Given  a  function  in  a  particular  application,  what  is  the  order  of  demand  between  the 
parameters  or  locally  defined  objects  locally? 

Function  Transformation 

The  first  step  in  the  order-of-demand  analysis  is  to  differentiate  between  the  (textual) 
occurrences  of  each  boimd  variable  in  a  function  definition.  Although  this  seems  strange 
at  first,  it  quickly  becomes  apparent  that  each  occurrence  of  a  variable  denotes  a  different 
instance  in  which  the  value  of  the  variable  could  be  demanded.  Roughly  speaking,  the 
order-of-demand  analysis  that  we  describe  can  determine  the  relative  order  in  which  the 
values  of  various  occurrences  of  a  variable,  or  several  variables,  are  demanded.  In  order  to 
make  each  occurrence  of  a  boimd  variable  distinct,  we  introduce  an  auxiliary  function  /'  for 
each  function  f  x\ . .  .x^  =  bodyf  based  on  the  same  transformation  described  in  Chapter  4. 
For  example,  the  auxiliary  function  f  of  f  given  above  is  defined  as  follows: 

f    wl   w2   xl   x2   x3   yl   y2   y3   zl   z2   z3   z4 

=    if   wl=0   then  zl+xl   elseif   yl=0   then  z2+x2 
else    (z3+y2)    +   f    (w2-l)    x3    (y3-l)    z4 

5.2      Before  Analysis 

In  this  section,  we  present  an  order-of-demand  analysis  called  before  analysis  which  provides 
safe  compile-time  information  about  before  demand  based  on  an  abstract  interpretation 
technique.  We  assume  that  the  underlying  evaluation  model  for  the  higher-order  non-strict 
functional  language  is  sequential  lazy  evaluation.  That  is,  the  evaluation  of  arguments  of 
strict  primitive  functions  are  predefined  in  a  sequential  order  (either  left-to-right  or  right- 
to-left)  at  compile-time  and  no  optimization  using  strictness  information  is  applied.  The 
cases  in  which  the  underlying  evaluation  model  is  a  parallel  lazy  evaluation  model  where 
arguments  of  strict  primitive  functions  may  be  evaluated  in  parallel,  and  an  optimized 
lazy  evaluation  using  strictness  information  in  which  all  strict  arguments  of  a  function  are 
evaluated  at  the  time  of  a  call  to  the  function  either  sequentially  or  in  parallel  will  be 
discussed  in  section  5.5. 
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5.2.1      Exact  Before  Semantics 

We  introduce  an  exact,  but  incomputable,  non-standard  denotational  semantics  called  be- 
fore semantics,  which  exactly  describes  the  actual  -<  relation  between  any  two  occurrences 
of  a  parameter  of  a  fimction  in  a  program.  Since  the  exact  before  relation  during  a  pro- 
gram's execution  depends  on  the  standard  values  themselves  (e.g.  the  standard  value  of  the 
predicate  part  of  a  conditional  will  determines  which  alternative  will  be  taken),  any  exact 
before  semantics  needs  to  contain  the  standard  meanings  of  expressions  as  well  as  before 
information. 

Two  sets  of  occurrences  of  parameters  of  a  function  will  be  analyzed  separately  to 
determine  the  function's  before  behavior.  We  say  that  two  particular  sets  of  occurrences  of 
parameters  of  a  function  interesting  sets  if  we  are  trying  to  determine  the  before  relation 
between  them.  Thus,  our  before  semantics  is  defined  in  terms  of  two  interesting  sets  X 
and  Y  of  occurrences  of  variables  inside  a  function.  The  exact  before  semantics  determines, 
given  an  expression  e  and  two  interesting  sets  X  and  Y  of  occurrences  of  variables  that  are 
contained  in  e,  whether  the  relation  X  <  Y  holds  as  a  result  of  the  evaluation  of  e. 

Representing  Before  Information 

For  each  expression,  its  corresponding  value  in  the  before  semantic  domain  should  indicate 
whether  the  relation  Y  before  X  holds  during  evaluation  or  not.  Under  the  non-standard 
before  semantics,  we  represent  the  meaning  of  an  expression  e,  with  respect  to  interesting 
sets  X  and  Y,  as  a  pair  in  the  non-standard  before  semantic  domain  Dt,  called  a  before 
pair, 

1.  whose  first  element  denotes  the  before  information  during  evaluation  of  the  expression, 
and 

2.  whose  second  element  denotes  the  functional  behavior  of  the  expression  e  when  it  is 
applied  to  another  expression. 

The  first  component  of  the  pair  is  an  element  of  a  domain  called  a  basic  before  domain,  Bt, 
which  is  a  three-element  domain  of  0,  1  and  2  ordered  by  0  C  1  C  2  as  shown  in  Figure  5.1. 
The  elements  in  Bt  are  interpreted  as  follows: 

•  2  :  For  each  occurrence  a:  6  .?f ,  x  is  demanded  and  no  occurrence  y  E  Y  is  demanded 
before  x  during  the  evaluation  of  e. 
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Figure  5.1:  The  Basic  Before  Domain 

•  1:  For  each  occurrence  x  £  X ,  neither  x  nor  y  E  Y  is  demanded  during  the  evaluation 
of  e. 

•  0  :  For  each  occurrence  x  £  X ,  either  x  is  demanded  and  an  occurrence  y  £  Y  is 
demanded  before  x  or  x  is  not  demanded  and  an  occurrence  y  £  Y  is  demanded  during 
the  evaluation  of  e. 

The  second  component  of  the  pair  is  a  fimction  over  Df,  whose  meaning  is  the  functional 
behavior  of  the  expression  e  when  it  is  applied  to  another  expression.  For  expressions  which 
have  no  higher-order  behavior,  err,  a  function  that  can  never  be  applied,  is  used. 

Before  Semantic  Domains 

The  before  semantic  domain  Dt  and  the  before  environment  Et  are  defined  as  follows: 
Dt     =     /^DJ  I*  Before  semantic  domain  */ 

r 

El     —     Id  ^  Dt      I*  Domain  of  before  environments  */ 

The  before  domain  Di  is  a  sum  doniain  consisting  of  each  subdomain  for  each  type.  The 
before  subdomain  D'[  for  expressions  of  type  r  is  defined  as  follows: 

DJ"'  =     jBf  X  {err}  subdomain  for  integers 

£)6oo/         _     B^  y^  {err}  subdomain  for  booleans 

D['~*^^     =     Bi  X  (Dl^  — >  D]^)     subdomain  for  functions  of  type  r^  — ♦  T2 

Before  Semantic  Functions 

We  introduce  the  non-standard  before  semantic  functions,  Tc,  Te,  and  Tpr,  which  give  non- 
standard before  meaning  to  constants,  expressions  and  programs,  respectively. 
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Con  — >  Dt  I*  Before  semantic  function  for  constants  */ 


Exp  —>  Et  —^  Dt      I*  Before  semantic  function  for  expressions  */ 
Program  -^  Dt        /*  Before  semantic  function  for  programs  */ 

We  define  a  binary  operator  I>  which  reflects  the  notion  of  sequential  evaluation  of  two 
expressions  as  follows: 

t>  :  Bt  -^  Bt  -^  Bt 

f/  >  y  =^  if  {U  =  1)  then  V  else  U 

Consider  an  expression  e  which  consists  of  two  subexpressions  C;  and  62  such  that  the 
evaluation  of  e\  is  followed  by  the  evaluation  of  62-  If  the  value  of  ej  in  Bt  with  respect 
to  X  and  F  is  0  then,  during  the  evaluation  of  ej,  any  demand  to  an  occurrence  x  £  X  \s 
preceded  by  a  demand  to  an  occurrence  2/  6  F  and,  furthermore,  at  least  one  occurrence 
in  Y  is  demanded.  Thus,  regardless  of  the  value  of  62  in  Bt,  the  before  information  of  e  is 
always  0. 

If  the  value  of  C]  in  Bt  with  respect  to  X  and  Y  is  2,  then,  during  the  evaluation  of  ei, 
any  demcind  to  an  occurrence  j/  G  F  is  preceded  by  a  demand  to  an  occurrence  x  ^  X  and, 
furthermore,  at  least  one  occurrence  in  X  is  demanded.  Thus,  regardless  of  the  value  of  63 
in  Bt,  the  before  information  of  e  is  always  2. 

If  the  value  of  Cj  in  Bt  with  respect  to  X  and  F  is  1,  then  no  occurrence  o  E  X  \JY 
is  demanded  during  evaluation  of  e^.  Therefore,  the  value  of  e  in  Bt  depends  only  on,  and 
is  equal  to,  the  value  of  62  in  Bf  Thus  the  t>  operator  reflects  precisely  the  notion  of 
sequential  evaluation  of  two  expressions. 

The  semantic  equations  for  the  before  semantic  functions  are  expressed  in  Figure  5.2. 
Oracle  is  used  to  resolve  the  exact  behavior  of  the  conditional  primitive  function,  deter- 
mining which  branch  would  be  evaluated  at  run-time.  Since  this  must  rely  on  the  standard 
value  of  a  predicate,  the  exact  before  semantics  is  not  computable  at  compile-time.  envt  is 
any  exact  before  environment  in  Et,  and  nullenvt  is  a  before  environment  that  maps  every 
identifier  to  the  least  element  of  its  before  semantic  domain. 

5.2.2      Abstract  Before  Semantics 

Since  the  information  that  the  before  semantics  provides  is  uncomputable  at  compile  time, 
it  is  not  suitable  as  a  basis  for  compile-time  analysis.  For  use  in  a  compiler,  we  need  a 
suitable  before  semantics  that  will  guarantee  termination  and  yet  still  provide  a  useful  and 
safe  approximation  to  the  exact  before  semantics.    In  this  section,  we  present  an  abstract 
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Tjcl     =     (l,e7T),ce  {..., -1,0,1,..., true, false} 

TMenvt      =     TM 
Telxjenvt     =     envtlxj 

Te|ei  +  e2Jenvt     =     let     /  =  Tgleijenvt         /*  same  for  Ci  -  62  and  Ci  =  62  */ 

r  =  Te|e2lent;t 
in      (/(I)  I>  r(i),err) 
Te[if  ei  then  £2  else  eajenut     =     let     p  =  Telcijenvt 

c  =  Tele2Jenvt 
a  =  T^fesjenvt 
in      if  Oracle(ei)  then  (p(i)  l>C(i),C(2)) 
else  (p(i)  I>  0(1),  0(2)) 
Teleie2Jenvt     =     let     /  =  Teleijenvt 

ap  =  f{2)iTele2JeTiVt) 
in      (/(I)  t>  ap(i),ap(2)) 
Te|lainbda(a;).eleni;,     =     {I,  Xy.T,le]envt{x  ^  y]) 
Tefletrec  i'l  =  ei; . . .;  z„  =  e^;  in  ejenvt     =     Tele}env[ 

where  env[  =  envt[xi  h^  Te|ei|ent;^, . . . ,  x^  h-»  Te[en|ent;f] 
Tpripr]     =     Te[pr]nu//enU( 

Figure  5.2:  Before  Semantic  Functions 
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Figure  5.3:  The  Abstract  Basic  Before  Domain 

interpretation  of  the  exact  before  semantics  that  allows  a  safe  approximation  of  the  exact 
before  behavior  to  be  found  at  compile-time. 

Abstract  Before  Semantic  Domains 

For  each  expression,  its  corresponding  value  in  the  abstract  before  semantic  domain  indicates 
whether  the  relation  of  Y  before  X  holds  definitely  during  the  evaluation  of  the  expression 
("before"),  and  whether  the  relation  of  Y  before  X  may  hold  during  the  evaluation  of  the 
expression  ("maybe  before").  As  an  abstraction  of  Bt,  we  define  an  abstract  basic  before 
domain  Bt  as  a  three-element  domain  of  0,  1  and  2  ordered  by  0  C  1  C  2  that  is  similar  to 
the  basic  before  domain  Bt  as  shown  in  Figure  5.3.  But,  the  interpretation  of  elements 
in  Bt  is  defined  differently  from  that  of  Bt  as  follows: 

•  2  :  For  each  occurrence  x  £  X ,  either  x  is  demanded  and  an  occurrence  y  E  Y  might 
(or  might  not)  be  demanded  before  x,  or  x  is  not  demanded  and  an  occurrence  y  €  F 
might  (or  might  not)  be  demanded  during  evaluation  of  e.  (In  other  words,  this  value 
denotes  the  absence  of  knowledge  about  the  relative  order  of  demands.) 

•  1  :  For  each  occurrence  x  ^  X ,  either  x  is  demanded  and  an  occurrence  y  €  F  is 
demanded  before  x,  or  x  is  not  demanded  and  an  occurrence  y  £  Y  might  (or  might 
not)  be  demanded  during  evaluation  of  e. 

•  0  :  For  each  occurrence  x  €  X,  either  x  is  demanded  and  an  occurrence  y  E  Y  \s 
demanded  before  x,  or  x  is  not  demanded  and  an  occurrence  y  E  1'  is  demanded 
during  the  eveduation  of  e. 

Note  that  the  value  in  Bt  of  an  expression  e  consisting  only  of  the  variable  x  is  2  if  z  6  A", 
0  if  X  G  Y ,  1  if  X  ^  {X  y^Y).  The  abstract  before  semantic  domain  D,,  the  domain  Et  of 
abstract  before  environments  are  defined  as  follows: 
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Z)j     =     Y^^i  I*  Abstract  before  semantic  domain  */ 

T 

Et     =     Id  -^  Dt      I*  Domain  of  abstract  before  environments  */ 

The  before  subdomain  D[  for  expressions  of  type  t  is  defined  as  follows: 

£)J"'  =     Bi  y.  {err}  abstract  subdomain  for  integers 

£)i>ool         _     Bt  y^  {err}  abstract  subdomain  for  booleans 

^n— T2     _     Bt  y  {DJ^  — *  DJ^)     abstract  subdomain  for  functions  of  type  tj  — +  T2 

Abstract  Before  Semantic  Functions 

The  abstract  before  semantic  functions  are  defined  as  follows: 
t 


Con  — »  Dt  I*  Abstract  before  semantic  function  for  constants  */ 

Exp  —*  Et  —*  Dt      I*  Abstract  before  semantic  function  for  expressions  */ 
Program  ^  Dt        /*  Abstract  before  semantic  function  for  programs  */ 

The  abstract  before  semantic  fimctions  are  given  in  Figure  5.4.  enuf  is  any  abstract  before 
environment  in  Et,  and  nullenvt  is  an  abstract  before  environment  that  maps  every  identifier 
to  the  least  element  of  its  abstract  before  semantic  domain. 

Safety  and  Termination 

We  introduce  the  notion  of  safety  which  relates  the  exact  before  semantics  to  the  abstract 
before  semantics.  Let  u  and  v  be  values  of  an  expression  e  of  type  r  or  r  list  in  Dt  and  Dt-, 
respectively.  Let  n  be  the  number  of  arguments  that  the  type  r  can  take  before  returning 
a  value  of  primitive  type.  We  say  that  u  is  a  safe  approximation  (with  respect  to  before 
information)  of  v  iff 

(NAPfc(t;,5i,...,5fc))(i,  C  (NAPfc(u,<i,...,ifc))(i)- 
for  all  A;  <  n  where  5,  is  a  safe  approximation  of  i,  for  all  i  <  k. 

Tlieorem  5.1  (Safety)  For  any  expression  e,  and  environments  envt  and  envt  such  that 
for  all  y,  enu^Jj/J  is  safe  for  envt^y],  Tglejefivt  is  safe  (with  respect  to  before  information) 
for  Tf,\e\envt.  Thus,  the  before  information  obtained  by  the  exact  before  semantics  implies 
the  before  information  obtained  by  the  abstract  before  semantics. 

Proof  :  We  can  prove  by  structural  induction  on  expression  e. 
I.  Base  Case: 
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Tclcj     =     (l,err)     c  G  {..., -1,  0, 1, ...,  true, false} 

tlcjefivt     =     tfcj 
Telxjefivt     =     ehvtlxj 

^e|ei  +  e2Jenvt     =     let     /  =  f^leijefivt         /*  same  for  Ci  -  62  and  ei  =  62  */ 

r  =  fele2Jenvt 
in      (/(I)   >  r(i),er7-) 
Te|if  Ci  then  62  else  Csjenvt     =     let    p  =  feleijenvt 

c  =  Tele2lenvt 
a  =  felesjenvt 
in      (p(i)  t>  C(i),C(2))U(P(i)  I>a(i),a(2)) 
^e[eie2]eniit     =     let     /  -  f^leijenvt) 

ap=  /(2)(^e|e2leni>t) 
in      (/(I)  t>a>(i),ap(2)) 
T4lambda(i).ejefi?;t     =     (1,  Ay.te|elent;,[a:  i->  y]) 
f ^{letxec  xi  =  ei;...;xn  =  e„;  in  ejenvt     =     TeleJenuJ 

where  envj  =  envt[xi  h^  TeleiJen^J, . . . ,  Xn  >-♦  Te|e„]eniij] 
^prlP''!     =     fclprjnulienvt 

Figure  5.4:  Abstract  Before  Semantic  Functions 
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1.  e  =  c:  f.lcjenvt  =  f.lcj  and  Telcjenvt  =  Tclcj.   For  c  6  {. . .  ,-1.0, 1 true, 

false,   nil,   null  }  ,  Tdcj  =  tdcj  and  then  it  clearly  holds. 

2.  e  =  x:  felxjenvt  =  envtlxj  and  Tefxjenvt  =  envtlzj.  Since,  for  all  y,  efivtlyj  is  safe 
for  envtly],  it  clearly  holds. 

II.  Structural  Induction  Step:  Assume  that  fe{ejenvt  is  safe  for  Telejenvt  for  expressions 
such  as  60,61,62,63  and  e^.  (structural  induction  hypothesis) 

1.  6  =  61 +62:  Te[6i+e2leni;«=  (/(i)  t>r(i),6rr)  where  /  =  Te[eijenz;t  and  r  =  fele2}envt. 
Telei  +  e2]envt=  (/(i)  t>r(i),err)  where  I  =  Teleijenvt  and  r  =  Tele2Jenvt.  By  the  structural 
induction  hypothesis,  /  and  f  are  safe  for  /  and  r,  respectively.  Thus,  it  holds.  Similarly,  it 
holds  for  61  —  62  and  ei  =62- 

2.  6  =  if  61  then  62  else  63:  Te|if  ej  then  62  else  e^Jenvt  =  {p(i)  \>  C(i),C(2))  U 
(p(i)  >  a(i),C(2))  where  p  =  f^leijenvt,  c  =  fele2Jenvt,  and  a  =  fele^jenvt.  Tgfif  61  then 
62  else  e3]6nt;t  is  either  (p(i)  t>  C(i),C(2))  or  (p(i)  I>  C(i),C(2))  where  p  =  Teleijenvt,  c  = 
tele2}efivt,  and  a  =  feleslenvt  depending  on  the  standard  semantic  value  of  ei.  In  any 
case,  by  the  structural  induction  hypothesis  and  the  definition  of  >,  it  holds. 

3.  e  =  6162:  te|6ie2leniit=  (/(j)  >  ap(i),ap(2))  where  /  =  f^leijenvt),  and  dp  = 
/(2)(TeIe2le7iv£).  Te[6i62lent;t=  (/(i)  t>  ap(i),  ap(2)>  where  /  =  felcijefivt),  and  ap  = 
/(2)(Te|e2len?;t).  By  the  structural  induction  hypothesis,  /  and  dp  are  safe  for  /  and  ap, 
respectively.  Then,  by  the  definition  of  [>  and  safe,  it  holds. 

4.  6  =  lambda(a;).6i:  Te|lambda(a;).6lenut=  {1,  Xy.t^lejefivtix  k-»  y]).  Te|lambda(a!).e] 
envt=  {l,Xy.Tele}envt[x  h->  y]).  By  the  structural  induction  hypothesis,  Te|6jeni'4[a;  1— ►  y] 
is  safe  for  Te|6]6nt;([a;  1— >  y]  and  thus  it  holds. 

5.  6  =  letrec  Xj  =  ej; . . .;  x„  =  6^;  in  cq:  Tefletrec  xi  =  ei; . . .;  Xn  =  e^;  in  eolenvt  = 
Teleolehv[  where  env[=  envt[xi  i—>  Telei}efiv[],  and  Te|letrec  xi  =  e^; . . .;  Xn  =  e^;  in  eo] 
envt=  Teleojenv[  where  env[—  envt[x,  1— >  Te|e,]6nt;j].  Here,  ei'iv'  and  env'  are  recursively 
defined.  We  prove  that  6nt;f Ij/J  is  safe  for  ent;J|j/J  for  all  y  by  fixpoint  induction  on  envi- 
roiunents  env'. 

1.  Base  Case:  The  first  approximation  env^  of  ehv[  is  enuji,  1— ►  ±].  The  first  approx- 
imation  env^  of  env'f^  is  eni;,[s,  h- »  ±].  Thus,  for  all  y,  env[lyj  is  safe  for  eni','|y]. 
Then,  by  the  structural  induction  hypothesis,  Te|6olenvj.  is  safe  for  Te|6ol6ni'j. 

2.  Fixpoint  Induction  Step:  Assume  that,  for  some  fixed  h  >  0,  the  fc""  approxima- 
tion  ent'j  'lyj  is  safe  for  env^  '|j/J  for  all  y.  (fixpoint  induction  hypothesis)  Then, 
The  {k  +  1)"*  approximation  efiVf         —  envja-,   1-^   Te|ei|env,    '],  and  env^  — 

'ik\  '  '  ( k\ 

envt[xi  H- »  Te[6,]6nUj     ].  By  the  structural  induction  hypothesis,  Te|e,||ent'j       is  safe 
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Figvue  5.5:  Relationship  cunong  Standard  emd  Before  semantics 

for  T^lei\env}''\    Thus,  env\^''^^\y\  is  safe  for  env}''^^\y\  for  all  y.    Then,  by  the 
structural  induction  hypothesis,  fe\eQ\env[  is  safe  for  T^leo\env[. 


Theorem  5.2  (Termination)  For  any  (finite)  program  pr  6  Program,  fprfprj  is  com- 
putable, i.e.  it  always  terminates  infinite  number  of  steps. 

Proof  :  All  the  abstract  before  semantic  domains  are  finite,  and,  because  the  operator  t> 
is  monotonic,  all  functions  over  before  semantics  domains  are  monotonic  functions.  Thus, 
the  fbcpoints  can  be  computed  in  a  finite  nimiber  of  steps,  and  the  interpretation  under  the 
abstract  before  semantics  is  guaranteed  to  terminate  for  all  programs.  □ 
The  relationship  among  the  standard  semantics  (SS),  the  non-standard  exact  before  se- 
mantics (BS),  and  the  abstract  before  semantics  (ABS)  is  shown  in  Figure  5.5. 

5.2.3      Testing  for  Before  Demand 

Since  the  abstract  before  semantics  is  guaranteed  to  terminate,  the  abstract  before  semantics 
can  be  used  as  a  basis  to  infer  the  before  information  at  compile-time.  We  consider  two 
kinds  of  before  information  for  higher-order  functions:  global  and  local.  The  global  before 
information  of  a  function  /  defined  by  /  ij  . . .  z„  =  bodyj  holds  true  for  every  possible 
application  of  /  to  n  arguments,  and  is  determined  by  examining  only  at  the  body  of  /. 
The  local  before  information  is  computed  for  a  particular  application  of  /  and  depends 
upon  the  niunber  cind  properties  of  the  arguments  in  the  application.  It  turns  out  that  the 
global  before  information  is  equivalent  to  the  local  before  information  in  case  of  first-order 
functions. 
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Global  Before  Test 

The  global  before  testing  of  a  function  /  is  performed  by  applying  the  abstract  before 
semantic  value  of  /  to  n  argimients  in  Dt  that  contain  the  least  before  information  possible. 
Thus,  any  before  information  obtained  from  the  application  arises  solely  from  properties  of 

/. 

Definition  5.2  (Worst-case  Before  Function)  For  each  type  t  such  that  m  is  the  num- 
ber of  argimients  that  a  fimction  of  type  r  can  take  before  returning  a  primitive  value,  we 
define  the  abstract  fimction  W^  that  corresponds  to  the  worst-case  (i.e.  least)  before  infor- 
mation. 

Axi.(l,Aa;2-(l,---,Azm-(lj2;.(i).err)...))     m  >  1 

I    CTT  m  =  0 

Given  a  function  /  defined  by  /  ii  ...!„  =  bodyf  of  type  f  :  t^  ^  . . .  -*  t^  -^  t,  two  sets 
X  and  Y  of  occurrences  of  the  formal  parameters  of  /,  and  an  abstract  before  semantic 
environment  ehvt  mapping  /  to  an  element  in  Dt,  the  global  analysis  fvmction  G.before? 
determines  whether  the  before  relation  between  X  and  Y  holds  globally.  It  is  defined  as 
follows: 

G -before? (/,  X,y,  enT;()  = 

Tel/'zn   ...  2i(,(i)  ...ini  •••a;no(n)le'^t^t[/' ^  /',a;.j  1-^  3/.j] 

where 

/'  is  the  auxiliary  function  for  /,  /'  =  Tel/'l^ni/t,  o[i)  is  the  nvmiber  of  occur- 
rences of  I,, 

for  each  Xij  £  X, 

for  each  2,j  G  Y, 

and  for  each  a;,_,  ^  X  U  F, 

The  value  that  G -before?  (/,  A,  V,  er'it'f)  returns  is  a  pair  (p,  g)  interpreted  as  follows: 

HI 


•  If  p  =  0  or  1,  then  we  can  conclude  that  Y  <  X  m  any  possible  application  of  /  to  n 
arguments. 

•  Otherwise,  if  p  =  2  then  an  occurrence  in  Y  might  or  might  not  be  demanded  before 
the  first  demand  of  any  occurrence  in  X .  Thus,  in  this  case,  we  cannot  conclude  that 
Y  ■<  X  in  a.]l  possible  applications  of  /. 

If  the  result  in  the  standard  semantics  of  the  application  of  /  to  n  arguments  is  a  function  g, 
then  G -before?  will  only  give  us  the  order-of-demand  information  about  the  bound  variable 
occurrences  inside  the  body  of  /  during  the  execution  of  the  application  of  /.  We  might  also 
want  to  obtain  order-of-demand  information  about  the  bound  variable  occurrences  inside  / 
if  g  were  subsequently  applied  to  other  arguments.  This  extra  amount  of  order-of-demand 
information  is  obtained  by  applying  g  to  the  abstract  value  (1,  W"^"),  where  Tg  is  the  type 
of  the  argument  expected  by  the  result  of  /. 
For  example,  consider  a  function  defined  by 

fxyz=ifx=0   then   lambda(w) .z+y+w 
else  lambda(w) .z*y*w 

The  auxiliary  function  f '  derived  from  f  is 

i'    X  yl  y2  zl  z2  =  if  X  =  0  then  lambda(w) .zl+yl+wl 

else  lambda(w) .z2*y2*w2 

G_before?(f  ,{yl  ,y2}  ,{zl  ,z2})  would  return  <  1,51  >  indicating  that  neither  y  nor  z  is 
demanded  during  an  application  off  to  three  arguments.  If  the  result  of  the  application  of 
f  is  applied  to  a  fourth  argument,  the  information  that  z  would  always  be  demanded  before 
y  can  be  obtained  by  applying  g  to  the  abstract  value  {I,  err). 

Local  Before  Test 

Given  a  function  /  defined  hy  f  xi  . . .  x^  =  bodyj  of  type  /:  tj  -♦...—»  t„  -^  t  in  a  par- 
ticular application  /  Ci  ...  e„,  two  sets  A'  and  Y  of  occurrences  of  /'s  formal  parameters, 
and  an  abstract  before  semantic  environment  ehvt  mapping  /  and  all  free  identifiers  within 
e-i  and  e„  to  elements  of  Dt,  the  local  analysis  function  L_before?  determines  whether  the 
before  relation  between  A'  and  }'  holds  locally  in  /  ei   ...  e^.  It  is  defined  as  follows: 

L_before?(/,  ei, . .  .,  e^,  A",  K  efivt)  = 

{f.lf  Xu     ■■■•Clo(l)    ■■■Xml---Xmo{m)h'^Vt[f'  ^    f\^.J^    X'Ah) 
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where 

/'  is  the  auxiliary  function  for  /,  /'  =  Telf'jefivt,  o{i)  is  the  number  of  occur- 
rences of  a;,-, 

for  each  Xij  G  X , 

for  each  Xij  G  Y, 

y,,  =  {0,{tlei}efivt)^2)), 
and  for  each  Xij  ^  X  UY, 

Vij  =  (l,(^ele.lent;t)(2))- 
Then, 

•  If  L ^before? (/,£:,...,  e^,  X,y',  enw()  =  0  or  1  then  we  can  conclude  that  y  -<  A"  in 
the  evaluation  of  (/  Cj    . .  .£„)• 

•  Otherwise,  if  L_before?(/,  Ci, . . .,  e„,X,y,  ehvt)  =  2  then  an  occurrence  in  Y  might  or 
raight  not  be  demanded  before  an  occurrence  in  X .  Thus,  in  this  case,  we  are  unable 
to  conclude  that  Y  <  X  during  the  evaluation  of  (/  ej   ...  e^). 

5.3      Using  Before  Analysis 

Our  motivation  for  developing  the  order-of-demand  analysis  is  to  obtain  evaluation  status 
information.  As  we  describe  above,  evaluation  status  information  can  be  used  to  optimize 
lazy  evaluation  by  avoiding  run-time  checks  to  see  if  a  bound  variable  is  evaluated  or  not. 
Since  each  occurrence  of  a  bound  variable  corresponds  to  a  potential  demand  for  the  value 
of  the  variable,  order-of-demand  analysis  is  used  to  determine  which  occurrences  correspond 
to  demands  of  an  already  evaluated  variable. 

As  a  nice  side-effect,  order-of-demand  analysis  can  be  used  to  compute  (approximately, 
of  course)  the  relative  evaluation  orders  of  the  parameters  of  a  function,  and  the  strictness 
properties  of  a  function. 
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5. 3.1  Computing  Status-of-Evaluation  Information 

Given  an  occurrence  z.j  of  a  bound  variable  x,,  if  we  can  determine  that  there  will  always 
be  some  other  occurrence  Xik  of  i,-  demanded  before  Xij,  then  no  run-time  test  of  the  status 
of  z,  is  required  when  a;,_,  is  demanded. 

We  can  determine  the  evaluation  status  of  z,j  when  it  is  demanded  by  computing  the 
order  of  demand  information  between  a;,_,  and  all  other  occurrences  of  z;. 

Theorem  5.3  Let  f  be  a  function  defined  by  f  Xi  . .  .i„  =  bodyf  and  xn, . . . ,1,0(1)  ^^  «'' 
the  occurrences  of  a;,-  in  bodyf .   Then, 

1.  (G-before?(/,  {i,j},{x,i,...,2-o(-)}  -  {x,j},  env())(i)  =  0  or  1  ^  whenever  x,^  is 
demanded,  x,  will  have  already  been  evaluated  and  thus  the  demand  can  be  satisfied 
by  retrieving  the  saved  value,  for  any  possible  application  of  f . 

2.  (G_before?(/,  {xii, . .  .,x,o(,)}  -  {z,j},  {z,_,},ent;4))(i)  =  0  or  1  =>  the  demand  on  Xij 
the  first  demand  of  any  occurrence  of  Xi,  and  thus  will  always  be  the  occurrence  (if 
any)  causing  the  evaluation  ofxi. 

Proof:  If  (G-before?(/,  {i.j},  {xii, . .  .,x,o(,)}  -  {z,j}),e)(i)  =  0  or  1  then  some  occurrence 
of  Xi  other  than  x,j  is  always  demanded  before  the  occurrence  x,j  is  ever  demanded  first. 
This  means  that  whenever  Xij  is  ever  demanded,  Xi  has  been  already  evaluated. 

If  (G-before?(/,  {x,i, . .  .,  z,o(,)}  -  {z.j},  {x,j},  ent;())(i)  =  0  or  1  then  before  any  occur- 
rence Xik  of  Xi,  k  /  J,  is  demanded  Xij  must  be  demanded.  Thus,  whenever  i,_,  is  ever 
demanded  it  is  the  first  demand  of  z,  which  causes  actual  evaluation  of  z,,  and  thus  Xij  has 
an  unevaluated  status.     □ 

A  similar  theorem  can  be  stated  about  the  use  of  the  local  before  analysis  to  provide 
evaluation  status  information  about  a  particular  function  application. 

5.3.2  Computing  Order-of-Evaluation  Information 

In  lazy  evaluation,  the  evaluation  of  an  argument  takes  place  only  when  some  occurrence  of 
the  corresponding  parameter  is  demanded.  The  order  of  evaluation  between  two  parameters 
of  a  function  can  be  determined  by  computing  the  order  of  demands  between  the  set  of 
occurrences  of  one  parameter  and  the  set  of  occurrences  of  the  other. 

Theorem  5.4  Let  f  be  a  function  defined  by  f  Xi  . .  .Xn  =  bodyj,  and  let  1,1 , ... ,  z,o(i)  (ind 
Xji, . .  .,x^„f^j)  be  all  of  the  occurrences  of  x,  and  Xj  in  bodyf,  respectively.   Then, 
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;.  (G_before?(/,  {a;,i,---,2;,o(.)},{2;ji,---,2jo(j)},enV())(i)  =  0  or  1  ^^;-  x^  is  evaluated 
before  x,  in  any  possible  application  of  f. 

Proof:  If  (G-before?(/,  {2;,i,...,2;,„(i)},{sji,...,a;jo(j)},ent'())(i)=  0  or  1  then  before  any 
demand  of  an  occurrence  Xik  of  Xi,  there  is  a  demand  on  an  occurrence  Xjm  of  Xj.  Thus, 
Xjis  always  evaluated  before  Xi. 

a 

A  similar  theorem  can  be  stated  about  the  use  of  the  local  before  analysis  to  provide 
evaluation  order  information  for  the  arguments  in  a  particular  function  application. 

It  is  important  to  note  that  although  it  is  clearly  not  necessary  to  distinguish  the  in- 
dividual occurrences  of  each  formal  parameter  to  perform  an  order-of-evaluation  analysis, 
there  is  no  added  cost  in  doing  so  (other  than  simply  labeling  the  occurrences).  Since  all 
occurrences  of  a  parameter  are  placed  in  the  same  set,  they  are  treated  as  a  unit  by  our 
order-of- demand  analysis.  The  cost  is  not  proportional  to  the  size  of  the  sets  of  occur- 
rences, but  rather  to  the  number  of  times  the  order-of-demand  analysis  must  be  performed 
on  different  sets. 

5.3.3      Computing  Strictness  Information 

Strictness  information  about  a  function,  both  in  any  possible  application  of  the  function 
and  in  a  particular  application  of  the  function,  can  be  determined  using  order-of-demand 
analysis.  Like  all  compile-time  strictness  analyses,  the  order-of-demand  analysis  provides  a 
safe  approximation  of  the  actual  strictness  properties  of  a  function. 

Theorem  5.5  Let  f  be  a  function  defined  by  f  Xi  . .  .Xn  =  bodyj  and  let  z,i, . .  ..x^gii\  be 
all  occurrences  of  a  single  parameter  x,  in  body/.    Then, 

1.  (G_before?(/,  {$},  {^ii, .  .  . ,  z,o(i)},  ent;()),i)  =  0  =>   f  is  strict  in  x^,  in  any  possible 
application  of  f . 

2.  L-before?(/,  Ci, . . .,  e„,  {$},  {z,i, . . .,  ij^j)},  eniij)  =  0  ^=>  f  is  strict  m  x,  m  the  par- 
ticular application  of  f  to  ej   through  €„. 

Proof  :  We  sketch  the  proof  here  for  the  global  strictness  analysis.  The  proof  for  the  local 
strictness  analysis  is  similar.  (G_before?(/,  {$},  {zjj, . . .,  a;,^^,)},  eni'())(jj  =  0  implies  one  of 
two  things: 

1.   At  least  one  of  r,]  . .  .x,o(,)  is  demanded  during  the  any  application  of  /  to  n  arguments. 
This  is  obtained  from  the  meaning  of  0  in  B^,  that  is  {j-,i  ..  .j;,o(,)}  -<  {$}. 
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2.  Or,  because  the  bottom  element  of  B^  is  0,  the  fbcpoint  finding  iteration  determined 
that  the  fixpoint  of  /'  is  a  function  that  always  return  0,  which  would  be  the  case  if 
/'  (and  thus  /)  is  everywhere  undefined  (non-terminating). 

In  either  case,  /  is  strict  with  respect  to  i^.  D 

5.3.4      Examples 

Consider  the  following  lazy  functional  program: 

letrec   f   w   x   y   z   =    if    (w=0)    then  z+x   elseif    (y=0) 

then  z+x   else    (z+y)    +   f    (w-1)    x    (y-1)    z 
in      ... 

We  assume  that  f  is  of  type  int  —>  int  -+  int  —*  int  — >  int.   The  definition  of  the  before 
semaintic  value  /  of  f  is: 

f  w  xy  z     =     ((u;(i)  >  Z(i)  [>  X(i))  U  (u;(i)  t>  (y(i)  i>  2(i)  >  a:(i))U 

(2/(1)   >  -(1)  0  2/(i)  1>  if  {^(i)  t>  l,err)x  (yji)   |>  I,  err)  2)(i))),  err) 
=     (('^(i)  >  ^(1)   >  X(i))  U  (w(i)  O  y(i)   t>  2(1)  >  a:(i))U 

(^(1)  I>  2/(1)   t>  2(1)   t>  (/  (u;(i)   b  l,e7T)  X  (2/(1)   I>  l,err)  z)(i))),err) 
Since  /  is  recursively  defined,  it  can  be  computed  in  a  finite  steps  using  a  fixpoint  finding 
method  as  follows: 

/(°)  w  X  y  z  =     (0,  err) 

/(I)  w  xy  z  =     ((u;(i)  I>  2(i)  t>  2-(i))  U  (w(i)  t>  y(i)  l>  2(i)  t>  i(i))U 

(w'(i)   >  y(i)  l>  -(1)  l>  0),err) 
/(2)  u;  2-  J/  2  =     ((u;(i)  t>  2(1)  \>  1(1))  U  (ti;(i)  I>  2/(1)  O  2(i)  I>  X(i))U 
{^{1)  l>  2/(1)   l>  -(1)  I>  0),e7T) 
Since  /'^'  =  /'^',  we  have  that 

fwxyz     =     (l,Au;.(l,Ax.(l,Aj/.(l,A2.((u;(i)  I>  2(1)   >  Z(i))U 

("^(1)  I>y(i)  > -(1)  >2-(i))U(u;(i)  t>y(i)  >2(i)  l>0),err)))))) 
The  auxiliary  function  f  of  f  is  defined  as  follows: 

f '    Hi    w2   xl    x2   x3   yl    y2   y3   zl   z2   z3  z4   =    if    (wl=0)    then   zl+xl 

elseif    (yl=0)    then  z2+x2 
else    (z3+y2)    +   f    (w2-l)    x3    (y3-l)    z4 
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Again,  notice  that  f  is  not  recursive,  but  rather  calls  f.  Then,  the  definition  of  the  before 
semantic  value  /'  of  f  is  given  as  follows  (without  a  fixpoint  iteration). 

/'  Wi   W2  Xl   X2  X3  2/1   y2   2/3  Zi   22   ^3  ^4   = 

(1,  Aw;i.(l,  Au;2.(l,  Aa;i.(l,  Az2-(1,  Aa;3.(l,  A2/i.(l,  A2/2-(l,  A2/3. 
(l,Ar:.(l,A22-{l,A23-(l,A;4-(("^i(i)  t>  ri(i)  I>  a;i(i))U 
(u;i(l)   I>  1/1(1)   I>-2(1)   t>  2^2(1))  LJ(u;i(i)   1>  2/1(1)   l>  ::3(1)   t>  2/2(1)  t> 
(/  (w^2(i)  >  l^e'-^)  2^3  (2/3(1)  >  '^,err)  z^\i)),err))))))))))))) 

Evaluation-Status  Information 

Let  ehvt  =  [f  h- >  /]. 

(G_before?(f ,  {y2},  {yl,  y3},  enu,))(i)  = 

Teli'    wl    w2   xl    x2   x3   yl    y2   y3   zl   z2   z3   z4lent;'t)(i)  =  1 

where 

env't     =     enujf  H-»  /',y2  H-+  (2,  err),  yl,y3  K->  (0,  err), 
wl,  w2,  xl,x2,x3,zl,z2,  z3,z4  i—  (1,  err)] 

Thus,  we  can  conclude  that  when  y2  is  demanded,  either  yl  or  y3  has  already  been  evaluated 
and  no  run-time  check  is  required.  Similarly,  we  conclude  that  when  y3  is  demanded,  either 
yl  or  y2  has  already  been  already  evaluated  because 

(G_before?(f ,  {y3},  {yl,  y2},  ehvt)\^)  = 

telf    Wl  w2  Xl  x2  x3  yl  y2  y3  zl  z2  23  z4lent;'()(i)  =  1 

where 

env'i     =     ehvt{f'  >—  /',y3  ^-♦  (2,  err),  yl,y2  i—  {0,err), 
wl,w2,xl,x2,x3,zl,z2,z3,z4^-»  (l,err)] 

And,  because 

(G_before?(f ,  {y2,  y3},  {yl},  envO)(i)  = 

Te[f'    Wl    w2   xl    x2   x3   yl    y2   y3   zl   22   z3   z4lenD'()(i)  =  1 

where 

env't     =     env([f'  i-»  /',y2,y3  H^  (2,  err),  yl  f-^  (0,e7T}, 
Wl,w2,xl,x2,x3,zl,z2,z3,24  ^  (1,  err)] 

we  can  conclude  that  yl  is  the  occurrence  of  y  that  is  demanded  first  within  f . 
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Evaluation-Order  Information 

(G.before?(f,{zl,z2,z3,z4},{wl,w2},env,))(i)  = 

Telf  wl  w2  xl  x2  x3  yl  y2  y3  zl  z2  z3  z4|ent;'t)(i)  =  0 

where 

env't     =     enufff  t-^  /',wl,w2  I-*  (0,  err),  zl,z2,z3, 24  i-»  (2,  err), 
xl,x2,x3,yl,y2,y3K^  {I, err)] 

Thus,  we  can  conclude  that  w  is  always  evaluated  before  z  in  f . 

Similarly,  we  also  conclude  that  z  is  always  evaluated  before  x  because 

(G.before?(f ,  {xl,x2,x3},  {zl,  z2,z3,z4},  eni;t))(i)  = 

Te|f'    Wl   w2   xl    x2   x3   yl    y2   y3   zl   z2   z3   z'ijenv't)^^)  =  0 

where 

env't     =     envt[f'  »— »  /',  zl,z2,z3,z4  i— »  (0,  err),xl,x2,  x3  *-♦  (2,  err), 
yl,y2,y3H^  {I, err)] 

Hence,  we  conclude  that  the  parameters  to  f  are  evaluated  in  the  order  w,  z,  x.  In  addition, 
we  can  conclude  that  w  is  evaluated  before  y,  if  y  is  evaluated  at  all.  We  cannot  conclude 
anything,  however,  about  the  relative  evaluation  order  between  x  and  y  and  between  z  and 

y- 

Strictness  Information 

(G.before?(f,{$},{wl,w2},eni;i))(:;  = 

Telf    wl   w2  xl   x2  x3  yl   y2  y3  zl  z2  z3  z4lem'',)(i)  =  0 

where 

env't   -   ehvt\±'   ^   /',wl,w2  >-.    (0,  e7-7-),xl,x2,x3,yl,y2,y3,zl,z2,  z3,z4  ^ 
(l,e7T)] 

Then,  we  conclude  that  f  is  strict  in  w.  Similarly,  we  conclude  that  f  is  strict  in  x  and  z, 
because 

(G_before?(f,{$},{xl,x2,x3},eni',))(i)  = 

Te|f'    wl    w2   xl    x2   x3   yl    y2   y3   zl   z2   z3   z4lent;',)(i)  =  0 

where 
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env't   =   ehvt[f'    ^-^   /',xl,x2,x3  ^   (0,  err),  wl,w2,yl,y2,y3,zl,z2,z3,z4 
{I, err)] 


(G-before?(f,{$},{zl,z2,z3,z4},eriWt))(i)  = 

te|f'    wl   w2  xl   x2  x3   yl   y2  y3  zl   z2  z3  z4|env't)(i)  =  0 


where 


env't   =  envt[f'   ►-»   /',zl,z2,z3,z4  h^    (0,  err),  wl,w2,xl,x2,x3,  yl,  y2,  y3 
(l,er7-)] 


However,  since 


(G_before?(f,{$},{yl,y2,y3},ent;t))(i)  = 

Te|f'    Wl    w2   xl    x2   x3   yl    y2   y3   zl   z2   z3   z4}ent;'t)(i)  =  1 

where 

env't   =  ehvt[f'    *-*   /',yl,y2,y3  i— >   (0,  err),  wl,w2,xl,x2,x3,zl,z2,  z3,  z4  i-» 
(l,e7T)] 

we  cannot  conclude  that  f  is  strict  in  y. 

5.4      Complexity  of  Before  Analysis 

The  abstract  interpretation  framework  for  order-of-demand  analysis  is  very  similar  to  the 
framework  for  strictness  analysis  except  that  a  three-element  (rather  than  two-element) 
domain  is  used  as  the  basic  abstract  semantic  domain.  Thus,  the  order  of  complexity  of 
order-of-demand  analysis  is  that  of  strictness  analysis  which  is  known  to  be  exponential 
in  the  worst-case.  The  majority  of  the  complexity  of  analysis  based  on  the  abstract  inter- 
pretation technique  comes  from  finding  the  fixpoints  of  recursive  functions  in  the  abstract 
semantic  domains.  Advanced  methods  for  finding  fixpoints  on  finite  domains  can  also  be 
applied  to  order-of-demand  analysis  in  order  to  reduce  the  average-case  complexity.  The 
complexity  of  finding  fixpoints  depends  on  the  size  of  the  abstract  semantic  domains.  It  has 
been  argued  that  for  many  function,  especially  in  the  higher-order  case,  finding  fixpoints  is 
intractable  unless  the  sizes  of  the  abstract  domains  are  reduced.  Our  method  has  a  much 
lower  complexity  than  the  path  model  [ll],  even  in  the  first-order  case. 


119 


5.5      Extensions  to  Other  Evaluation  Models 

So  far  we  have  described  the  order-of-demand  analysis  for  a  sequential  lazy  evaluation  model. 
In  this  section,  we  discuss  various  extensions  to  parallel  lazy  evaluation,  to  optimized  lazy 
evaluation  using  strictness  information,  and  to  non-flat  domains. 

Consider  a  parallel  lazy  evaluation  model  in  which  arguments  of  primitive  functions  may 
be  evaluated  in  parallel.  The  semantic  equations  of  the  abstract  before  semantic  function 
for  strict  primitive  functions  are  modified  as  follows: 

Tefci  +  e2}envt     =     let     /  =  Teleijehvt/*  same  for  ei  -  62  and  ei  =  63  */ 

r  =  %le2}envt 

P=    (^(1)    t>^(l))U(7-(i)     >/(!)) 

in      (p,err) 

Consider  an  optimized  lazy  evaluation  model  in  which  all  strict  arguments  of  a  user- 
defined  function  are  evaluated  either  sequentially  or  in  parallel  before  the  execution  of 
the  function.  We  assume  that  each  function  definition  is  annotated  to  indicate  in  which 
arguments  it  is  strict.  The  semantic  equation  of  the  abstract  before  semantic  function  for 
All ... .  Ai„.e  is  modified  as  follows: 

fjAzi Xx^.ejefivt     =     lei  ap  =  {fele}envt[x,  >-^  y,]) 

in  (l,A2/i.(l,...A2/„.((l  b  s  I>  ap(i)),  ap(2)) . . .)) 

where 

•  In  sequential  (left-to- right)  evaluation  of  strict  arguments:  s  =  (t/i)(i)  !>...[>  (yn)(i) 
where  each  Xi,  1  <  z  <  n  is  strict  parameter. 

•  In  sequential  (right-to-left)  evaluation  of  strict  arguments:  s  =  (t/n)(i)  [>  •  •  •  I>  (3/i)(i) 
where  each  a;,,  1  <  z  <  n  is  strict  parameter. 

•  In  parallel  evaluation  of  strict  arguments:  s  =  [_J  (l/i)(i) 

i  s.t    X,  is  a  strict  paraTneter 

A  naive  way  for  the  before  analysis  to  handle  a  language  with  non-flat  domains  (due  to 
lists)  is  that  when  an  object  is  put  in  a  list  we  assume  that  it  could  be  demanded  whenever 
car  or  cdr  is  applied  to  that  list.  The  abstract  before  subdomain  Dt  for  expressions  of  type 
T  list  is  defined  as  follows: 

DJ '"'     =     DJ     abstract  subdomain  for  hsts 
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The  abstract  before  semantic  function  T^  for  constants  associated  with  list-type  expressions 
is  defined  as  follows: 

tjnil]  =  {l,err) 

tclconsi  =  (l,Ax.(l,A2/.(2,X(2)U2/(2)))) 

fjcarl  =  {l,Xx.x) 

fjcdrj  =  (l,A2;.a;) 

Tc|nulll  =  (l,A2;.(a;(i),e7T)) 

Clearly,  more  work  remains  to  be  done  to  provide  a  more  precise  analysis  for  languages  with 
non-flat  domains. 
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Chapter  6 


Polymorphic  Invariance 


All  the  semantic  analyses  presented  in  the  preceding  chapters  have  dealt  with  a  higher-order 
functional  lamguage  with  a  monomorphic  type  system  in  which  every  expression  is  rigidly 
typed.  Most  modern  fimctional  languages  adopt  a  rich  polymorphic  type  system  which  is 
more  flexible. 

In  this  chapter,  we  present  a  method,  based  on  the  notion  of  polymorphic  invariance  ([l], 
[3]),  for  applying  the  escape  analysis,  the  reference  escape  analysis,  and  the  order-of- demand 
analysis  to  a  polymorphic  language  using  the  analysis  techniques  for  a  monomorphic  lan- 
guage. First,  we  describe  the  notion  of  polymorphic  invariance  of  information  and  analysis 
on  polymorphic  functional  languages.  The  proofs  of  polymorphic  invariance  of  the  escape 
analysis,  the  reference  escape  analysis,  and  the  order- of- demand  analysis  are  then  presented. 
Finally,  we  discussed  the  approach  for  analyzing  polymorphic  functions. 

6.1      Issues  in  Analyzing  Polymorphic  Functions 

Most  modern  fimctional  programming  languages  support  some  polymorphism  with  a  flexible 
polymorphic  type  system.  A  function  is  said  to  be  polymorphic  if  it  can  be  applied  uniformly 
to  arguments  of  a  range  of  types  more  than  one  type.  We  particularly  concentrate  on  a  kind 
of  polymorphism,  called  parametric  (generic)  polymorphism,  which  most  modern  functional 
languages  like  ML  support.  Type  expressions  are  parameterized  with  type  parameters  and 
all  type  parameters  are  universally  quantified  at  the  top  level. 

Each  semantic  analysis  for  monomorphic  languages  presented  in  the  previous  chapters 
can  be  applied  to  polymorphic  languages  by  performing  monomorphic  semantic  analysis  to 
each  monomorphic  instance  of  a  polymorphic  function.  There  are,  however,  two  problems 
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connected  with  this  approach  ([1],  [3]): 

•  The  number  of  monomorphic  instances  of  a  polymorphic  function  becomes  infinite  as 
soon  as  we  allow  structured  types  or  higher-order  functions. 

•  The  size  of  the  abstract  domain  for  structured  and  higher-order  types  goes  so  fast 
that  fixpoint  computations  become  infeasible 

Thus,  this  approach  of  performing  the  semantic  analysis  for  a  monomorphic  language  on 
each  monomorphic  instance  of  a  polymorphic  function  is  semantically  sound,  but  is  not 
satisfactory  from  a  pragmatic  point  of  view.  Analysis  of  higher-order  polymorphic  functions 
is  best  done  by  proving  a  polymorphic  invariance  result  for  the  analysis  and  then  computing 
those  non-basic  instances  of  the  abstract  functions  necessary  to  compute  all  basic  instances 
of  the  abstract  functions. 

6.2      Polymorphic  Invariance 

We  define  the  notion  of  the  polymorphic  invariance  of  properties  and  of  analyses  for  poly- 
morphic languages  ([1],  [3]). 

Definition  6.1  (The  Polymorphic  Invariance  of  a  Property)  Let  P  be  a  property  of 
expressions  over  a  polymorphic  language.  P  is  said  to  be  polymorphically  invariant  if  e' 
satisfies  P  <=^  e"  satisfies  P  for  all  e  G  Exp,  for  all  e',  e"  in  the  set  of  possible  monomorphic 
instances  of  e. 

This  says  that  if  a  property  is  polymorphically  invariant  then  for  any  polymorphic  expression 
e,  that  property  must  hold  either  for  all  its  monomorphic  instances  or  for  none. 

Definition  6.2  (The  Polymorphic  Invariance  of  an  Analysis)  Let  A  be  an  analysis 
for  detecting  some  property.  A  is  polymorphically  invariant  if  the  application  of  the  analysis 
to  any  two  monomorphic  instances  of  a  polymorphic  function  always  yields  identical  results. 

This  means  that  if  an  analysis  is  polymorphically  invariant  then  a  polymorphic  fimction  can 
be  analyzed  by  considering  only  one  of  its  monomorphic  instances,  since  the  result  would 
apply  to  all  its  monomorphic  instances. 
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6.3      Polymorphic  Invariance  Proofs 

We  thiak  of  a  polymorphic  function  as  a  generic  notation  for  the  set  of  its  possible  monomor- 
phic  instances.  When  we  apply  the  function  in  an  actual  computation,  the  iiltimate  effect 
is  that  data  of  a  determinate  base  type  is  produced,  so  we  can  regard  each  application  as 
one  of  the  monotype  instances.  This  suggest  that  sets  of  monomorphic  instances  for  some 
polymorphically  typed  expression  are  handled  in  a  semantically  natural  fashion,  and  that 
some  properties  should  be  invariant  over  such  sets. 

6.3.1      Escape  Analysis 

The  polymorphic  invariance  of  the  escape  property  of  functions  implies  that  whether  a 
parameter  escapes  from  a  fimction  or  not  is  independent  of  the  type  of  the  parameter.  Thus, 
given  a  polymorphic  function,  it  will  return  the  same  escape  result  on  any  two  monomorphic 
instances  of  the  function.  As  a  consequence  of  this  fact,  the  escape  analysis  problem  for 
polymorphic  functions  can  be  reduced  to  the  escape  analysis  problem  for  monomorphic 
functions.  Since  a  smaller  types  means  fewer  elements  of  that  type,  and  since  the  efficiency 
of  escape  analysis  and  similar  analyses  reqmring  fixpoint  finding  is  dependent  on  the  number 
of  elements  in  the  domain,  the  proof  that  our  escape  analysis  is  polymorphically  invariant 
is  important.  By  means  of  this  reduction,  it  should  be  possible  in  practice  to  confine 
applications  of  the  escape  analysis  method  to  lower-order  types. 

We  prove  that  our  escape  analysis  is  indeed  polymorphically  invjiriant,  that  is,  given  a 
polymorphic  function,  it  will  return  the  identical  escape  result  on  any  two  monomorphic 
instances  of  the  function.  We  first  introduce  a  relation  cimong  all  possible  monomorphic 
instances  of  a  polymorphic  function  which  relates  them  with  respect  to  their  escape  property. 
Given  a  polymorphic  expression  e,  consider  any  two  of  its  monomorphic  instances  e'  and 
e"  as  follows:  e'  and  e"  are  of  type  r'  and  r",  and  n'  and  n"  are  the  number  of  arguments 
that  the  types  r'  and  r"  can  take  before  returning  a  primitive  value,  respectively.  Let 
u'  and  u"  be  the  values  in  the  abstract  escape  domain  Dg  of  e'  and  e",  respectively.  We 
define  a  notion  of  similarity  hetween  u'  and  u"  with  respect  to  the  escape  property,  written 
u'  ~~  u",  which  relates  the  escape  property  of  u'  to  that  of  u" .  We  say  that  u'  ^-^  u"  iff 

(NAPfc(w',5i,...,5fc))(i)  =  (NAP;i(u",ia,...,<0)(i) 
for  all  k  <  n,  where  n  is  the  minimum  of  n'  and  n",  and  for  all  i  <  k,  s,  ~~  <,. 
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Lemma  6.1  Let  f  be  a  polymorphic  recursive  function  defined  as  f  x^  . . .  Xn  =  e  where 
e  contains  free  variables  vi  ...Vm-  Let  f  and  f  be  two  monomorphic  instances  of  f,  typed 
as  follows: 

[v,:a'{,...,v^:a':^]f":T^^...^T'^-^T" 


where  each  a  and  r  is  a  monotype.  For  monotyped  abstract  escape  environments  env'^  and 
env"  that  map  each  Vi  to  an  element  in  Do  such  that  for  each  Vi,  env'^lvi}  ~''~  ent;"|t;;|, 

/'  ~~  /" 

where  /'  =  del>'3:i Xx^-ejenv'^  and  f"  =  Oel-^^;! Ax„.e|ent;;'. 

Proof  :     Let  env'^  and  ehv"  be  defined  as  follows: 

env'o=  env'oif  ^  Oe[  /'  }ehv'„], 
env':=  env'Jif"  ^  O.l  f"  jenv';] 

and  let  /'  and  /"  be  defined  as  follows: 

/'  =  env'Jf] 
f"  =  en<'[/"l 

We  can  prove  /'  ~~  /"  by  fixpoint  induction  on  /,  i.e.  envo- 

(I)  Base  Case  of  Fixpoint  Induction  :  The  first  approximation  /  ("^  of/'  is  (0,  >^yi.{yi{i)-,  A3/2- 
(yi(i)  U  y2(i),----^2/n-LT')  •••>)>•  The  first  approximation  /"(")  of  /"  is  {0,  \yi.{yi{i),  >^y2- 
{yi{i)  LJy2(i)r---'^2/n--LT")  •••>>>•  Since  1^'  ~~  -Lr",  it  holds. 

(II)  Fixpoint  Induction  Step  :  Assume  that  /'f'")  ~°~  /"('")  for  some  m  >  0.  (fixpoint 
induction  hypothesis)  Then,  we  prove  that  /'('"+i)  ~''~  f"{m  +  i)_  -phis  can  be  proved  by 
structural  induction  on  expression  e.  Let  envj"''  and  env^^""'  be  env'^lx,  i—>  j/,,  f  ^  f  '""'] 
and  env'J,[x^  h-+  y,],  /"  v-*  /"''"'],  respectively. 

I.  Base  Case  of  Structural  Induction: 

1.  e  =  c  :  /'(-  +  !)  =  (0,A2/i. (2/1(1),  At/2.  (2/1(1)  U  y2(i),  •■  •  Aj/^.O^W)  - .  •)))•  Similarly, 
/"(-  +  ')  =  (0,Ayi.(t/i(i),Aj/2.(2/i(i)Uj/2(i),...  Ay„.0,lcl)...))).  Since  OeW  =  OcW, 
it  holds. 

2.  e  =  I  :  /'(-  +  !)  =  (0,Ayi.(3/,(i),Ay2.(yi(i)U  3/2(1),  •••  Ay^-Oe^l  ehv^^) . . .))  and 
/"(-  +  ')  =  (0,  Ayi.(y,(i),  Ay2.(j/i(,)Uy2(i),  ■  •  •  Ay^.Oe^I  env'^^) . . .))).  By  the  fixpoint 
induction  hypothesis,  in  eitlier  x  =  x^  or  x  =  f,  it  holds. 
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II.  Structiiral  Induction  Step:  Assume  that  /'("»)  ~~  /"(">)  for  ei,e2  and  63.  (structural 
induction  hypothesis)  ' 

1.  e  =  ei  +  62  :  Since  /'("'+i)  =  (0,  Aj/i.(yi(i),  A2/2.(yi(i)  U  1/2(1),  •  •  •  Aj/n.(0,  err)) . . .))  and 
/"('"+1)  =  {0,Aj/i.(j/m),A7/2.(yi(i)U  2/2(1),...  Ay„.(0,err))...))),  it  holds.  Similarly, 
this  holds  for  ej  —  €2  and  ei  =  62. 

2.  e  =  if  ei  then  cj  else  eg  :  /'('"+i)  =  (0,  A2/i.(j/i(i),  Ay2-(yi(i)  U  2/2(1), . . .  \yn-{6A^2\ 
ent;l('")u0ele3l  eni;^)))  ...)).  /"(-+i)  =  (0,  Aj/i. (2/1(1),  A2/2.(j/i(i)U2/2(i), . . .  Ay^.fOJezl 
ehvj^'^'l\0e\e3\  efivj^"^')) . . .))).  By  the  fixpoint  and  structural  induction  hypotheses, 
it  holds. 

3.  e  =  6162  :  /'("■+^)  =  (0,  A2/1. (2/1(1),  A2/2.(j/i(i)U2/2(i),  •  •  ■  Aj,„.(04ei]  env'j"'^^  (O^ezI 
ent;;("'))) . . .))),  and  /"(-+i)  =  (0,  A2/i.(2/i(i),  A2/2.(2/i(i)U2/2(i), . . .  A2/„.(0eIeiI  envl'("->)(2) 
(Oe|[e2l  enu^^"'')) . . .))).  By  the  structural  induction  hypothesis  and  the  definition  of 
~~,  it  holds. 

4.  e  =  lambda(a:).ei  :  /V+i)  =  (0,  A2/1. (2/1(1),  Ay2.(j/i(i)  U  2/2(1),  •■  •  A2/„.(F',  Ay.Oeleil 
env'.^-'^lx,  ^  2/.])  )■•■))),  and  /""(-+i)  =  (0,  Ayi. (2/1(1),  A2/2.(yi(i)  U  2/2(1), ...  Ay„.(l/", 
Ay.OJeil  envl^^'^lx,  k.  2/.))  )...»)•  Since  env'j^^lzj)  ~°~  enT;l'("')lzI),  V'  =  V". 
Then,  by  the  structural  induction  hypothesis,  it  holds. 

D 

The  above  lemma  says  that  all  possible  monomotype  instances  of  a  polymorphic  function 

are  similar  with  respect  to  escape  property  of  their  argimients  and  local  objects.    Based 

on  this  fact,  we  prove  that  both  the  global  and  local  escape  analyses  are  polymorphically 

invariant. 

Theorem  6.1  (Global  Escape  Analysis)  Let  f  be  a  polymorphic  function  of  arity  n, 
and  let  f  and  f"  be  any  two  monomorphic  instances  of  f.  Assume  that  env'  and  env"  are 
abstract  escape  semantic  environments  that  map  f  and  f"  to  elements  of  Do,  respectively. 
Then,  for  I  <  i  <  n, 

G_escape?(/',i,  env')  =  G_escape?(/",  i,  enu") 

Proof  :     From  the  definition  of  the  global  escape  test  function, 

G_escape?(/',  i,  env')  =  (de[/  Xi   ...  z„l  env'[x,  >-^  y,]){i) 

where  y[  =  (1,W'<)  and,  for  j  <  n  and  ;  7^  f,  y'^  =  (0,  W^').  Let  /'  =  ent-'|/l.  Then,  by 
the  definition  of  Of, 
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G.escape?(/',t,ent;')  =  (NAP„(/',  j/J, . . . ,  y;))(i). 
Similarly, 

G.escape?(/",z-,eni;')  =  (NAP„(/",  t/^',  •  •  • ,  2/n))(i) 

where  /"  =  env"lfj,  z/f  =  {1,W<)  and,  for  j  <  n  and  j  /  i,  y'J  =  (0,1^^").  By  the 
definition  of  the  worst-case  escape  function  W,  y'f^  ~~  y^'  for  all  1  <  A;  <  n.  Thus,  by  the 
Lemma  6.1,  /'  ~~  /".  Then,  by  defijiition  of  ~~,  we  have  that  (NAP„(/',  2/^, . . . ,  y;))(i) 
=  (NAPn(/",j/i',  ...,2/;'))(i).  Thus,  we  conclude  that 

G_escape?(/',  z,  eni;')  =  G_escape?(/",  i,  env"). 

D 

Theorem  6.2  (Local  Escape  Analysis)  Let  f  be  a  polymorphic  function  of  arity  n  in 
an  application  /  ej  . . .  e„.  Let  f  and  f"  be  any  two  monomorphic  instances  of  f ,  and  e'- 
and  e"  be  two  monomorphic  instances  o/e^.  Assume  that  env'  and  env"  are  abstract  escape 
semantic  environments  that  map  f  and  all  free  identifiers  within  e[,  and  f"  and  all  free 
identifiers  within  e"  to  elements  of  Do,  respectively.   Then,  for  1  <  i  <  n, 

L_escape?(/',  i,  e[,  ...,e'^,  env')  =  L_escape?(/",  i,  e'/,  ...,e'^,  env") 

Proof  :  This  can  be  proved  in  a  similar  way  to  the  polymorphic  invariance  proof  of  the 
global  escape  analysis.  □ 

6.3.2      Refined  Escape  Analysis 

The  polymorphic  invariance  of  the  refined  escape  property  of  functions  implies  that  the 
extent  of  a  parameter  which  does  not  escape  front  the  function  call  is  independent  of  the  type 
of  the  parameter.  Thus,  given  a  polymorphic  function,  it  will  return  the  same  refined  escape 
result  on  any  two  monomorphic  instances  of  the  function.  The  polymorphic  invariance  of 
the  refined  escape  analysis  means  that  given  a  polymorphic  function,  it  will  return  the 
same  refined  escape  result  for  any  two  monomorphic  instances  of  that  function.  Actually, 
the  refined  escape  analysis  is  polymorphically  invariant  when  it  is  stated  the  following  way: 

Given  a  polymorphic  function,  the  number  of  spines  of  a  parameter  that  does 
not  escape  from  the  function  application  is  the  same  for  any  two  monomorphic 
instances  of  the  function. 
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Prom  this  point  of  view,  we  will  prove  that  our  refined  escape  analysis  is  indeed  polymor- 
phically  invariant.  We  introduce  a  relation  among  all  possible  monomorphic  instances  of 
a  polymorphic  function  which  relates  them  with  respect  to  their  refined  escape  property 
as  stated  above.  Given  a  polymorphic  expression  e,  consider  any  two  its  monomorphic 
instances  e'  and  e"  as  foUows:  e'  and  e"  are  of  type  r'  and  r",  and  n'  and  n"  are  the 
number  of  arguments  that  the  types  t'  and  r"  can  take  before  returning  a  primitive  value, 
respectively.  Let  u'  and  u"  be  the  values  in  the  abstract  refined  escape  domain  Dp  of  e' 
and  e",  respectively.  We  define  a  notion  of  similarity  between  u'  and  u"  with  respect  to  the 
refined  escape  property,  written  u'  ~~  u",  which  relates  the  refined  escape  property  of  u' 
to  that  of  u".  We  say  that  u'  ~''~  u"  iff 

NAPfc(ti',5,,...,5i))(i)  =  NAPfc(iz",ti,...,<fc))(i)  =  (0,0) 

or 

NAP„(u',5i,...,5fc))(i)(i,  =  NAP„(u",<i,...,/t))(i)(i)  =  1  and 
d'-NAP„(u',5i,...,50)(i)(2)  =  d"-NAP„(u",<i,...,<fc))(i)(2) 

for  all  fc  <  n  where  n  is  the  minimimi  of  n'  and  n",  for  all  j  <  k,  (5j)(i)  =  (1,  d'-)  and  (<j)(i)  = 
{l,d'-)  where  d'  and  d"  is  the  number  of  spines  of  the  j"*  parameter  of  that  n  parameters, 
for  all  /  7^  j  and  /  <  k,  (5;)(i)  =  (t/)(i)  =  (0,0),  and  for  all  i  <  k,  5,  ~~  ti. 

Lemma  6.2  Let  f  be  a  polymorphic  recursive  function  defined  as  f  xi  . . .  Xj^  —  e  where 
e  contains  free  variables  v\  . .  .Vm-  Let  f  and  f  be  two  monomorphic  instances  of  f ,  typed 
as  follows: 

{v,:<j[ v^:a'Jf':T[^...^T:,-^T' 

where  each  a  and  r  is  a  monotype.  For  monotyped  abstract  refined  escape  environments  env'p 
and  env'p  that  map  each  v,  to  an  element  in  Dp  such  that  for  each  v,,  enVpfvij  ~~  enVpfvil, 

/'     J'r^      f" 

where  /'  =  P,l\x^. .  .  .  Xxn-cjenv'^  and  f"  =  P.lXxi.  .  .  .  Xx^.ejenv'^. 

Proof  :     Let  env'  and  ehv''  be  defined  as  follows: 

env'^=  env;\f'  ^  P^  f  jenv'p], 
ehv';=  env';\f"  ^  P4  f"  jenv;] 
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and  let  /'  and  /"  be  defined  as  follows: 

f"  =  env';if"} 

We  can  prove  this  by  fixpoint  induction  on  /,  i.e.  enVp. 

(I)  Base  Case  of  Fixpoint  Induction  :  The  first  approximation  /  (°'  of/'  ((0,  0),  Ayi.(?/i(i),  A2/2. 
{yi{i)^y2{i),---^yn--^T')  ■■■))}■   The  first  approximation  /"(°)  of/"  ((0,  0),  Ai/i.(yi(i),  A3/2. 
(j/i(i)LJ  2/2(1),- •■A3/„.X^")...))).  Since  ±^.  ~''~  ±r',  it  holds. 

(II)  Fixpoint  Induction  Step  :  Assume  that  /'(">)  ~~  /"("»)  for  some  m  >  0.  (fixpoint 
induction  hypothesis)  Then,  we  prove  that  /  (^"+1)  ~~  y"(m+i)_  This  can  be  proved  by 
structural  induction  on  expression  e.  Let  env^"'''  and  ehvj^'^'  be  env'p[x^  1— »  j/,,  /'  i->  /'''"^] 
and  envp[xi  i->  j/,],  /"  i->  /"''")],  respectively. 

I.  Base  Case  of  Structural  Induction: 

1.  e  =  c:  /'(-+!)  =  ((0,0),Ayi.(t/i(i),Ay2-  (j/i(i)  U  2/2(1),  •••  Aj/„.Pc[cl) ..  .)))•  Similarly, 
/"(-+1)  =  ((0,0),A2/i.(2/i(i),A2/2.(2/i(i)U  2/2(1),  ••■  A2/„.Pjcl) . . .))).  Thus,  clearly  it 
holds. 

2.  e  =  x:  /'(-+!)  =  ((0,0),A2/i.(2/i(i),A2/2.(2/i(i)U2/2(i),...A2/„.PeIa:Ient.;("'))...))and 
/"(-+i)  =  ((0,0),A2/i.(2/i(i),A2/2.(2/i(i)U  2/2(1),...  Az/^.^W  em,;*™)) . . .))).  By  the 
fixpoint  induction  hypothesis,  in  either  x  =  a;,  or  2;  =  /,  it  holds. 

II.  Structural  Induction  Step:  Assimie  that  /'t"^)  ~~  f"(^)  for  ei,e2  and  e^.  (structural 
induction  hypothesis) 

1.  e  =  e:+e2:  Since /'("'  +  i)  =  ((0,  0),  A2/i.(yi(i),  A2/2.(2/i(i)U2/2(i), ...  A2/n.((0,  0),  err)) .. .)) 
and  /"('"+^)  =  ((0,0),  A2/1. (2/1(1),  A2/2. (2/1(1)  U  ^2(1),  ■  ■  ■  A2/,.((0,  0),  err))  .. .))),  it  holds. 
Similarly,  this  holds  for  Ci  —  62  and  Ci  =  e2. 

2.  e  =  if  ei  then  £2  else  63  :  /'('"+i)  =  ((0,  0),  Xyi-iy^^),  Xy2-{yi{i)\-iy2{i),  ■  ■  ■  A2/n.(Pe|e2l 
e7it;;('")  U  Fjeal  env'}"'^)) . . .))  and  /"(-+i)  =  ((0,  0),  Aj/,. (2/1(1),  A2/2.(2/i(i)  U  2/2(1), -. . 
\yn-{Pele2J  enVp'""' uPelesl  enUp*'"*))  . . .))).  By  the  fixpoint  and  structural  induction 
hypotheses,  it  holds. 

3.  e  =  eie2  :  /'('"  +  ^)  =  ((0, 0),  Ayi.(2/i(i),  A2/2.(yi(i)  U  ^2(1),  ■  ■ .  Xyn.(Pele,}  env'^^^)^^) 
(PeM  ent-;*-)))  . . .))).  /"(-+!)  =  ((0,  0),  Ayi. (2/1(1),  Ay2. (2/1(1,  U  2/2(1),  ■  ■  •  A2/„.(Pe[eiI 
env  '"')(2)  (Pel^2l  ^'^'^'p  ))  • .  •)))■  By  the  structural  induction  hypothesis  and  the 
definition  of  ~~,  it  holds. 
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4.  e  =  lambda(2:).ei  :  /'("'+i)  =  {{0,0),\yl.{y^(^^),Xy2.{y^,)Uy2^,), . . .  Xyn.{V',  Xy-P^e,] 
efiv'^^^'^Xi  ^  yi])  ) . .  .))>,  and  /"(-+1)  =  ((0,  0),  Xy:.{y^^^,  Xy2.{yi(i)Uy^i),  •  •  •  A3/„.(K", 
Xy.Peleij  envl^^'^xi  ^  yi])  )...))).  Since  env'p^"''>lzj)  -"-  env^^^'^lzj),  V'  =  V". 
Then,  by  the  structural  induction  hypothesis,  it  holds. 

D 

The  above  lemma  says  that  all  possible  monomorphic  instances  of  a  polymorphic  function 
are  related  with  respect  to  refined  escape  property  of  their  arguments  and  local  objects. 
Based  on  this  fact,  we  prove  that  both  the  global  and  local  refined  escape  analyses  are 
polymorphically  invariant. 

Theorem  6.3  (Global  Refined  Escape  Analysis)  Let  f  be  a  polymorphic  function  of 
arity  n,  and  let  f  and  f"  be  any  two  monomorphic  instances  of  f .  Assum,e  that  env'  and 
env"  are  abstract  refined  escape  semantic  environments  that  map  f  and  f"  to  elements  of 
Dp,  respectively.   Then,  for  1  <  i  <  n, 

G-rescape?(/',i,enz;')  =  (0,0)  <=^  G.rescapel{f",i,env")  =  (0,0) 

or 

G-rescape?(/',i,enu')  =  {l,k')  <=^  G-rescape?(/",  f,  env")  =  {l,k") 

such  that  s[  —  k'  =  s'-'  —  k"  where  s'^  and  s"  are  the  number  of  spines  of  the  i"* 

parameter  of  f  and  f",  respectively. 

Proof  :     From  the  definition  of  the  global  refined  escape  test  function, 

G-rescape?(/',  z,  env')  =  {Pelf  Xi   . .  .  z^J  env'[x,  ^  y,])(i) 

where  y,'  =  ((1.5;),VF<)  and,  for  j  <  n  and  j  /  i,  y'^  =  ((0,0)1^^^').  Let  /'  =  cnv'lf]. 
Then,  by  the  definition  of  P^,  Then, 

G_rescape?(/',f,ent-')  =  (NAP„(/',  yj, . . . ,  y;))(i,. 

Similarly, 

G_rescape?(/",i,ent/)  =  (NAP„(/",  yj', . . .,  j/;'))(i) 

where  /"  =  env"lfl  y,"  =  {{l,s'^),W^")  and,  for  j  <n  and  j  ^  i,  y'J  =  ((0,0)1^"^").  By 
the  definition  of  the  worst-case  escape  function  W,  y^  ~~  y]^'  for  all  1  <  *  <  n.  Thus,  by 
the  Lemma  6.2,  /'  ~''~  /".  Then,  by  definition  of  ~~,  we  have  that 

NAP„(/',y;....,y;,)  =  NAP„(/",y;',...,y;')  =  (0,0) 
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or 

(NAP„(/',y;,...,2/;))(i)(i)  =  (NAP„(/",3/;',...,j/;'))(:)(2)  =  l 
and 

.:-(NAP„(/',j/;,...,2/:))(i)(2)  =  .r-(NAP„(/",j/i',...,y;'))(i)(2) 
Thus,  we  conclude  that  it  holds.  □ 

Theorem  6.4  (Local  Refined  Escape  Analysis)  Let  f  he  a  polymorphic  function  of  ar- 
ity  n  in  an  application  /  Cj  . . .  e„.  Let  f  and  f"  be  any  two  monomorphic  instances  of  f , 
and  e[  and  e"  be  two  monomorphic  instances  o/e;.  Assume  that  env'  and  env"  are  abstract 
escape  semantic  environments  that  map  f  and  all  free  identifiers  within  e[,  and  f"  and  all 
free  identifiers  within  e"  to  elements  of  Dp,  respectively.   Then,  for  I  <  i  <  n, 

L_rescape?(/',z,e'i,...,e;,en?;')  =  (0,0) 

<=>  L_rescape?(/",i,e'/,...,e;^,enT;")  =  (0,0) 

or 

L_rescape?(/',  i,  e',, .  . . ,  e^,  env')  =  (0,  0)  =  (1,  k') 

<=^  L_rescape?(/",  i,  e'{,  ...,e';,  env")  =  (0, 0)  =  (1,  k") 
such  that  s'-  —  k'  =  s'-   —  k"  where  s[  and  s"  are  the  number  of  spines  of  e\  and 
e" ,  respectively. 

Proof  :  This  can  be  proved  in  a  similar  way  to  the  polymorphic  invariance  proof  of  the 
global  refined  escape  analysis.  D 

6.3.3      Reference  Escape  Analysis 

The  polymorphic  invariance  of  the  reference  escape  property  of  functions  says  that  whether 
a  reference  to  a  heap  allocated  object  escapes  a  call  to  a  polymorphic  function  or  not  is 
independent  of  the  type  of  the  object  to  which  the  reference  is  pointing.  This  means  that 
given  a  polymorphic  function,  reference  escape  analysis  will  provide  the  same  reference 
escape  result  on  any  two  monomorphic  instances  of  that  function. 

We  prove  that  our  reference  escape  analysis  is  indeed  polymorphically  invariant.  We 
introduce  a  relation  among  all  possible  monomorphic  instances  of  a  polymorphic  function 
which  relates  them  with  respect  to  their  reference  escape  property.  Given  a  polymorphic 
expression  e,  consider  any  two  its  monomorphic  instances  e'  and  e"  as  follows:  e'  and  e" 
are  of  type  r'  and  r",  and  n'  and  n"  are  the  number  of  arguments  that  the  types  r'  and  r" 
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can  take  before  returning  a  primitive  value,  respectively.  Let  u'  and  u"  be  the  values  in  the 
abstract  reference  escape  domain  Dr  of  e'  and  e",  respectively.  Let  u'  and  u"  be  the  values 
in  the  abstract  reference  escape  domain  Dr  of  e'  and  e",  respectively.  We  define  a  notion  of 
similarity  between  u'  and  u"  with  respect  to  reference  escape  property,  written  u'  ~~  u", 
which  relates  the  reference  escape  property  of  u'  to  that  of  u".  We  say  that  u'  ^-^  u"  iff 

(NAPfc(u',  31, ... ,  5fc))(i)(i)  =  (NAPfc(iz",  <i, . . .,  <fc))(i,(i, 

for  all  fc  <  n  where  n  is  the  minimum  of  n'  and  n",  and  for  all  i  <  k,  5,-  ~'~  t,. 

Lemma  6.3  Le<  f  be  a  polymorphic  recursive  function  defined  as  f  Xi  . . .  z„  =  e  where 
e  contains  free  variables  vi  . .  .Vm-  Let  f  and  f  be  two  monomorphic  instances  of  f ,  typed 
as  follows: 

[v,:a[,...,Vm:a'Jf':ri-^...^r:,-*T' 
[v,:a'{,...,Vr„:a'^]f":T{'-^...^T-^T" 

where  each  a  and  t  is  a  monotype.  For  monotyped  abstract  reference  escape  environments 
env'r  and  env"  that  map  each  Vi  to  an  element  in  D^  and  for  each  i;,,  eni'^|t;,|  ~'~  ent;"|t;i], 
respectively, 

fi  ^r^  f" 

where  f  =  Re\\x-[. . .  .A2;„.e]en?;^  and  f"  =  R^lXxi. . .  .Azn.ejenn". 

Proof  :     Let  eiivl  and  ent;"  be  defined  as  follows: 

ehv',=  env'rif  ^  R,l  f  jenv'^], 
ehv';=  env'Jif"  ^  R,l  f"  jenv'^] 

and  let  /'  and  /"  be  defined  as  follows: 

/'  =  en<|/'l 
/"  =  ehv':if"j 

We  can  prove  /'  ~~  /"  by  fixpoint  induction  on  /,  i.e.  envr- 

(I)  Base  Case  of  Fixpoint  Induction  :  The  first  approximation  /  '"'  of/'  is  ((0,  0).  Aj/i.(yi(j),  Ay2- 
(2/1(1) Uj/2(i),  ■ .  ■  Aj/„.J_^.) . . .))).  The  first  approximation  /"'°>  of  /"  is  ((0,0),  Xyi.{yni),Xy2- 
(yi(i)  U  2/2(1),  •••'^3/n--Lr")  ••■)))•  Since  _L^.  ~~  J.^.,  it  holds. 

(II)  Fixpoint  Induction  Step  :  Assume  that  /'('")  --""^  /"("•)  for  some  m  >  0.  (fi.xpoint 
induction  hypothesis)  Then,  we  prove  that  /'('"  +  ''  -J-^  /"('"  +  ').    This  can  be  proved  by 
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structural  induction  on  expression  e.  Let  ent;^^"''  and  envj^"*^  be  envl[x,  ^  yi,  f  ^  f  *'"'] 
and  env'^[xi  h^  j/.],  /"  i->  /"*'"^],  respectively. 

I.  Base  Case  of  Structural  Induction: 

1.  e  =  c:  /'('"+^)  =  {(0,0),Ayi. (2/1(1),  A2/2.  (2/1(1)  U  2/2(1),  ••■  At/n.^c|cl)  •■  .)))•  Similarly, 
/"(-+!)  =  ((0,0),A2/i.(2/i(i),Ay2-(2/i(i)U2/2(i),.--  \yn-Rclc\)  ■.■))) ■  Thus,  clearly  it 
holds. 

2.  e  =  x:  /'('"+1)  =  ((0,  0),  Ayi.(yi(i),  A2/2.(2/i(i)  U  2/2(1),  •  •  •  A2/„.^e  W  en^;''")) . . .))  and 
/"(-+!)  =  ((0,0),A2/i.(2/i(i),Ay2.(2/i(i)U  2/2(1),...  ^VuXM  ^"0'"')  •  •  •»)•  By  the 
fbcpoint  induction  hypothesis,  in  either  z  =  x;  or  a;  =  /,  it  holds. 

II.  Structural  Induction  Step:  Assume  that  /'(™)  ~~  /"l'")  for  61,62  and  63.  (structural 
induction  hypothesis) 

1.  6  =  61+62  :  Since  /'('"+i)  =  ((0, 0),  A2/1. (2/1(1),  A2/2.(2/i(i)U2/2(i), .  • .  A2/„.((0,  0),  err)) . . .)) 
and  /"('"+1)  =  ((0, 0),  A2/i.(yi(i),  Xy2-{yni)  U  2/2(1), . . .  Ay„.((0,  0),  err)) . . .))),  it  holds. 
Similarly,  this  holds  for  ei  -  62  and  ei  =62- 

2.  6  =  if  61  then  62  else  63  :  /'('"+i)  =  ((0,  0),  Ayi.(yi(i),  Ay2-(yi(i)Uy2(i), .  • .  \yn-{Rele2} 
ent;;(-)  U  Ee|e3l  env^^)) . . .))  and  /'V+i)  =  ((0,  0),  A2/i.(yi(i),  A2/2.(yi(i)  U  ^2(1), .  -  • 
Ay„.(^e|e2l  6nt;"('"'u^ele3l  efiv"^"'^)) . . .))).  By  the  fixpoint  and  structural  induction 
hypotheses,  it  holds. 

3.  6  =  6162  :  /'("^+^'  =  ((0,0),Ayi.(yi(i),Ay2.(yi(i)Uy2(i),.-.  Xyn-Me,}  env'}"'^)^^) 
[R^e^j  efiv'}"'^)) . . .))).  /"(-+!)  =  ((0, 0),  A2/i.(yi(i),  Ay2.(yi(i)  U  y2(i), . . .  Ay„.(^e[eil 
e/m !.'('"' )(2)  (-Re|Ie2l  env"*"'^))  ...))).  By  the  structural  induction  hypothesis  and  the 
definition  of  ~~,  it  holds. 

4.  6  =  lainbda(a;).ei  :  /'('"+i)  =  ((0,  0),  \yi.{y,(i),  Ay2.(yi(i)Uy2(i),  •  •  ■  ^n-{V',  Xy.Releij 
env'}^^[x,  ^  y.])  )  . . .))),  and  /"(-+i)  =  ((0,  0),  Ayi.(yi(i),  Ay2.(yi(i)Uy2(i),  • . .  Ay„.(y", 
Ay.^46il  env';^^^\x,  ^  y,])  )...))).  Since  env'^-^^lzj)  ~~  em/'('")l-i),  V'  =  V". 
Then,  by  the  structural  induction  hypothesis,  it  holds. 

D 

The  above  lemma  says  that  all  possible  monomorphic  instances  of  a  polymorphic  function 
are  similar  with  respect  to  reference  escape  property  of  references  created  within  them. 
Based  on  this  fact,  we  prove  that  both  the  global  and  local  reference  escape  analyses  are 
polymorphically  invariant. 
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Theorem  6.5  (Global  Reference  Escape  Analysis)  Let  f  be  a  polymorphic  function 
of  arity  n,  and  let  f  and  f"  be  any  two  monomorphic  instances  of  f .  Assume  that  env'  and 
env"  are  abstract  reference  escape  semantic  environments  that  map  f  and  f"  to  elements 
of  D^,  respectively.   Then,  for  1  <  i  <  n  and  for  1  <  j  <  o{i), 

G_refescape?(/',  z,_/,  enu')  =  G_refescape?(/",  i,  j,  env"). 

Proof  :  Let  /^  and  Z^'  be  the  auxiliary  functions  for  /'  and  /",  respectively.  From  the 
definition  of  the  global  reference  escape  test, 

G-refescape?(/',2,;,  ent;')  =  {Relfa  Xu   ■■■  a:no(n)IeTiv'[/a  '-^  f'a^^^j  ^  ytj]){i)(i) 

where  /'  =  R^lfjenv',  f',  =  kAf',\env'[f'  ^  /'],  y[^  =  {{\,s\),W<),  for  all  k  <  o[i)  and 
k  ^  i,  y[^  =  ((0,0),  H^^'),  and  for  all  1  <  m  <  o(/)  and  /  ^  i,  j//^  =  {{0,0),W!).  Then,  by 
the  definition  of  iZe, 

G-refescape?(/',2,j,ent;')  =  {NA'Pm{h,y'u,---,y'„„^„^))(i)(i) 

where  m  =  X^,  0(2)-  Similarly, 

G-refescape?(/",z,j,ent-")  =  (NAP„(/;,2/;'i,...,2/;;„(„j))(i,(,) 

where  /"  =  R^fjenv",  f-  =  R,lf:i}env"[f"  ^  /"],  y','^  =  {{l,s'l),W<'),  for  all  k  <  oii) 
and  k  ^  J,  y'^^  =  {{0,0), W<),  and  for  aU  1  <  m  <  o(l)  and  /  ^  i,  y['^  =  {{0,0), W<). 
By  Lemma  6.3,  /'  ~'^~  /"  and  thus  /^  ~~  /^'.  By  the  definitions  of  the  worst-case  escape 
function  W,  y[-  ~'~  y''  for  all  1  <  z  <  n  and  1  <  j  <  o{i).  Then,  by  the  definition  of  ~~, 

NAP^(/^2/;,,...,y:.„,„))(i)  =  NAP„(/:i',2/;'j,...,2/::„(„))(i). 

Thus,  we  conclude  that 

G-refescape?(/',  2,  J,  enii')  =  G.refescape?(/",  i,  j,  env") 


Theorem  6.6  (Local  Reference  Escape  Analysis)  Let  f  be  a  polymorphic  function  of 
arity  n  in  an  application  f  e\  ...  Cn-  Let  f  and  f"  be  any  two  monomorphic  instances 
of  f,  and  e[  and  e"  be  two  monomorphic  instances  of  e,.  Assume  that  env'  and  env"  are 
abstract  escape  semantic  environments  that  map  f  and  all  free  identifiers  within  e[,  and  f" 
and  all  free  identifiers  within  e"  to  elements  of  Dr,  respectively.  Then,  for  1  <i  <n  and 
for  I  <  j  <  o(i). 


1:54 


L.refescape?(/',  i,  j,  e\, . . . ,  e^,  env')  =  L_refescape?(/",  i,j,  e'{,  ...,e'^,  env") 

Proof  :  This  can  be  proved  in  a  similar  way  to  the  polymorphic  invariance  proof  of  the 
global  reference  escape  analysis.  □ 

As  a  consequence  of  this  fact,  the  reference  escape  analysis  problem  for  polymorphic 
fimctions  can  be  reduced  to  the  problem  for  monomorphic  functions.  The  reference  escape 
analysis  algorithm  need  only  be  applied  to  the  simplest  monomorphic  instance  of  a  fvmction. 
Smaller  types  implies  fewer  elements  of  that  type,  and  the  efficiency  of  reference  escape 
analysis  and  similair  analyses  requiring  fixpoint  finding  is  dependent  on  the  number  of 
elements  in  the  domain. 

6.3.4      Order-of-Demand  Analysis 

The  polymorphic  invariance  of  the  order-of-demand  property  of  functions  implies  that  the 
order  of  demand  between  parameters  of  a  function  during  the  evaluation  of  the  function 
is  independent  of  the  type  of  the  parameters.  Thus,  given  a  polymorphic  fimction,  it  will 
return  the  same  escape  result  on  any  two  monomorphic  instances  of  the  function. 

We  prove  that  our  before  analysis  is  indeed  polymorphicaUy  invariant.  We  introduce  a 
relation  among  all  possible  monomorphic  instances  of  a  polymorphic  function  which  relates 
them  with  respect  to  their  order-of-demand  property.  Given  a  polymorphic  expression  e, 
consider  any  two  its  monomorphic  instances  e'  and  e"  as  follows:  e'  and  e"  are  of  type  r' 
and  r",  and  n'  and  n"  are  the  number  of  arguments  that  the  types  t'  and  r"  can  take 
before  returning  a  primitive  value,  respectively.  Let  u'  and  u"  be  the  values  in  the  abstract 
before  domain  Dt  of  e'  and  e",  respectively.  We  define  a  notion  of  similarity  between  u'  and 
u"  with  respect  to  order-of-demand  property,  written  u'  ~~  u",  which  relates  the  before 
property  of  u'  to  that  of  u" .  We  say  that  u'  ~~  u"  iff 

(NAPi(i.',5i,...,50)(:)  =  (NAPfe(u",<i,...,<fc))(i) 

for  all  k  <  n  where  n  is  the  minimum  of  n'  and  n",  and  for  all  i  <  k,  Si  ~~  t,. 

Lemma  6.4  Let  f  be  a  polymorphic  recursive  function  defined  as  f  Xi  . . .  a;„  =  e  where 
e  contains  free  variables  v^  . . .  Vm  ■  Let  f  and  f  be  two  monomorphic  instances  of  f,  typed 
as  follows: 


\vi  :a{,...,v^:  a'^]f'  :  Tj'  ^  . .  .  ^  <  - 
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where  each  a  and  r  is  a  monotype.  For  monotyped  abstract  before  environments  env[  and 
env['  that  map  each  v,  to  an  element  in  Dt  and  jor  each  v,,  env[\vi\  ~~  eni;"|i;ij,  respec- 
tively, 

f>   rJ^   f" 

where  f'  =  TelXxi. . .  .\Xn.e}env[  and  f"  =  TdXxi. . . . Xxn.elenv" . 
Proof  :     Let  ehv[  and  ent;"  be  defined  as  follows: 

env[=  envlif  ^  tf  f  jenv[l 
ehv'l=  env'l\j"  ^  f,l  f"  }ehv['] 

and  let  /'  and  /"  be  defined  as  follows: 

/'  =  env[m 
f"  =  env';if"] 

We  can  prove  /'  ~~  /"  by  fixpoint  induction  on  /,  i.e.  enVf 

(I)  Base  Case  of  Fixpoint  Induction  :  The  first  approximation  /  ^°'  of/'  is  (1,  Ayi.(l,  A3/2. 

(1, .  ..Xyn.±r')  ■  ■  •)))•  The  first  approximation  /"(°)  of/"  is  (1,  Aj/i.(l,  Az/z-  (1,  ■  ..Xy„.±r")  ■  ■  ■)))■ 
Since  J.^-'  ~~  -L^",  it  holds. 

(II)  Fixpoint  Induction  Step  :  Assume  that  /'(">)  ~'-  /"("■)  for  some  m  >  0.  (fixpoint 
induction  hypothesis)  Then,  we  prove  that  /("'+i)  ~~  /"("•  +  !).  This  can  be  proved  by 
structural  induction  on  expression  e.  Let  enu,  and  enuj  be  env[[xi  i-+  j/,,  /'  1—  /  ^"^'] 
and  env'f'lxi  1-^  j/,],  /"  1— >  /  ^^^],  respectively. 

I.  Base  Case  of  Structural  Induction: 

1.  e  =  c  :  /'('"+1)  =  (l,Ayi.(l,At/2.  (1,...  Ay^.tlcJ)  . . .))).  Similarly,  P"'^')  = 
(1,  A2/i.(l,  At/2.(1,  . . .  Xyn-tlcj) ...))).  Thus,  clearly  it  holds. 

2.  e  =  x:  /'(-  +  !)  =  (l,A2/i.(l,Aj/2.(l,...Ay„.tH  env}"^^)  . . .)).  /"(-  +  ^)  =  (l,Aj„.(l, 
A2/2.{1,...  Xyn-Telxj  env/'"') .  •  •)))•  By  the  fixpoint  induction  hypothesis,  in  either 
x  =  Xi  OT  X  =  f,  it  holds. 

II.  Structural  Induction  Step:  Assume  that  /'(">'  ~~  /"<"•)  for  ei,e2  and  63.  (structural 
induction  hypothesis) 

1.  e  =  ei+e2  :  Let  /'  =  tle,jenv[^"'^  and  r'  =  tle2Jenv}^\  Let  /"  =  tle.jenv'i^"'^  and 
r"  =  tle2Jefiv'^^"'\  Then,  /'('"  +  ^'  =  (1,  Ay,.(l,  Ai/2.(1, . . .  Ay„.(/|j)  >  r|,j,  err)) . . .)) 
and  /"('"+1)  =  (l,Ayi.(l,Ay2-(l,.-.  Aj/„. (/,",,  O  r|',,,err)) . . .))).  By  the  structural 
induction  hypothesis  and  the  definition  of  ~~,  it  holds. 
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2.  e  =  if  ei  then  e-i  else  63  :  Let  p'  =  Teleileni;/'"',  c'  =  f^\e-2\ehv^\  and  o!  = 
t,{e^\env\^'^\  Let  p"  =  tle^\envl^"'\  c"  =  f,le^\ehv[^"'\  and  a"  =  tie4ehv"^"'\ 

Then,  /'(-+i)  =  (l,A2/i.(l,A2/2.(l,...  At/„.(p'(j)  >  ^'(1,,  c^^,)  U(P(i)  >  a'^,),  a^^)))  •  •  •)) 
and  /"(-+i)  =  (l,Ayi.(l,A2/2.(l,...  A2/„.(p'(',)  >  ^('1),  <2))  U(P('i)  >  a'(^^,  a'^^^)) ...))) . 
By  the  structural  induction  hypothesis  and  the  definition  of  ~~,  it  holds. 

3.  e  =  e,e2  :  Let  /'  =  tle.lenv}"'^  ap'  =  f^^^itle^lenv}-^^).  Let  /"  =  T^le^\ehv",^"'^], 
ap"  =  /(2)(tele2len^"^™^ 

Then,  /'(-+!)  =  (l,Aj/i.(l,Aj/2.(l,...  Ay„.(/('j)  t>  ap[^^, ap[^^)) ...))) ,  and  /'V+D  = 
(l,Aj/i.(l,Ay2-(l,---  Ayn.(/("j  t>  ap"jj,  ap^'j))) . . .))).  By  the  structural  induction  hy- 
pothesis and  the  definition  of  ~~,  it  holds. 

4.  e  =  lambda(2-).ei  :  /'(-+i)  =  {l,\yr.{l,  \y2.{l,. . .  Ay„.(l,  At/.TeleJ  ent;;^"'^[x.  h^ 
y.])  )...))),  and  /"(-+i)  =  (1,  Ayi.(l,  Aj/2.(1,  -  •  •  Ay„.(l,  At/.tjeil  en^J'^^'i^z  -»  V.]) 
)...))).  enUf      l^l)  ~~  enuj       [z]),  and  by  structural  induction  hypothesis,  it  holds. 

□ 

The  above  lemma  says  that  all  possible  monomorphic  instances  of  a  polymorphic  function 
are  related  with  respect  to  the  order-of-demand  property  of  all  occurrences  of  their  param- 
eters and  local  objects.  Based  on  this  fact,  we  prove  that  both  the  global  and  local  before 
analyses  are  polymorphically  invariant. 

Theorem  6.7  (Global  Before  Analysis)  Let  f  be  a  polymorphic  function  of  arity  n, 
and  let  f  and  f"  be  any  two  monomorphic  instances  of  f.  Assume  that  env'  and  env" 
are  abstract  before  escape  semantic  environments  that  map  /'  and  f"  to  elements  of  Dt, 
respectively.   Then,  for  X  and  Y , 

G.before?(/',.Y,r,eni/)  =  G_before?(/",  .Y,  1',  enu") 

Proof  :  Let  /^  and  /^'  be  the  auxiliary  functions  for  /'  and  /",  respectively.  From  the 
definition  of  the  global  before  test  function, 

G.before?(/',.Y,y,ent;')  =  (te|/:  m   ••■  x„„(„)|ent;'[/^  ^  /'„,x,,  ^  y,,]\,y 

Then,  by  the  definition  of  T^, 

G.before?(/',X,y,en,;')  =  (NAP^(/^,  yji, . . . ,  y^^^^,)),:, 

where  m  =  T„o{i),  /'  =  tU'jenv',  ^  =  Te\f'a¥riv'[f'  ^  /'],  for  each  x„  €  X,  y[^  = 
{2.W<),  for  each  2-,_,  €  Y,  y[^  =  (0,  Vi-'^),  and  for  each  z,^  ^  X  U  1'.  y[^  =  (1,W^'"')- 
Similarly, 


G.before?(/",X,F,enr;")  =  (NAP„(/^',  j/^'j, . . .,  j,;'^(^,))(,) 

where  /"  =  tlfjenv",  f-  =  tW}env"[f"  ^  /"],  for  each  Xij  e  X,  y.'^  =  {2,W<'),  for 
each  X,,  £  Y,  y'/^  =  {0,W<),  and  for  each  Xij  ^  XuY,  y'^-  =  {l,W<').  By  Lemma  6.4, 
/'  ~~  /"  and  thus  /^  ~~  /^'.  By  the  definition  of  the  worst-case  escape  function  W, 
y'ij  ~~  2/i'j-  Then,  by  the  definition  of  ~~,  we  have  that 

Thus,  we  conclude  that 

G.before?(/',X,y,ent;')  =  G. before? (/",  X,y,  ent;") 

D 

Theorem  6.8  (Local  Before  Analysis)  Let  f  be  a  polymorphic  function  of  ariiy  n  in 
an  application  /  ej  ...  e„.  Let  f  and  f"  be  any  two  monomorphic  instances  of  f,  and  e'- 
and  e"  be  two  monomorphic  instances  of  Ci.  Assume  that  env'  and  env"  are  abstract  escape 
semantic  environments  that  map  f  and  all  free  identifiers  within  e\,  and  f"  and  all  free 
identifiers  within  e"  to  elements  of  Dt,  respectively.   Then,  for  X  and  Y , 

L.before?(/',  A',  Y,  e[, . . . ,  e^,  env')  =  L.before?(/",  A",  Y,  e'{, . . . ,  e^',  env") 

Proof  :  This  can  be  proved  in  a  similar  way  to  the  polymorphic  invariance  proof  of  the 
global  before  analysis.  □ 

6.4      Analysis  of  Polymorphic  Languages 

The  type  variables  appearing  in  the  type  of  a  lambda-bound  identifier,  called  non-generic 
type  variables,  are  shared  in  every  occurrence  of  the  identifier  in  the  function  body,  and 
caimot  be  instantiated  to  different  types  in  the  same  expression.  However,  the  type  variables 
which  occur  in  the  type  of  a  letrec-bound  identifier,  called  generic  type  variables,  can  be 
instantiated  to  different  types  in  the  same  expression.  Since  the  letrec-bound  identifier  is 
local  to  the  expression,  we  know  exactly  how  it  is  defined  and  can  use  this  information  to 
deal  with  each  of  its  occurrences  individually. 

In  proving  the  polymorphic  invariance  of  the  semantic  analysis,  we  treated  a  poly- 
morphic expression  as  the  set  of  its  possible  monomorphic  instances.  In  this  section,  we 
describe  the  semantic  analysis  of  a  higher-order  functional  language  with  a  polymorphic 
type  system  which  allows  generic  (parametric)  polymorphism,  and  all  type  variables  are 
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universally  quantified  at  the  top  level.  Furthermore,  quantifiers  can  not  be  nested  inside 
type  expression,  Ccilled  shallow  types.  Occurrences  of  the  same  generic  letrec-bound  iden- 
tifier may  have  different  monotyped-instances.  This  can  be  resolved  by  making  each  of 
difTerently  monotyped  occvirrences  a  distinct  non-generic  identifier.  We  transform  each 
letrec-expression  as  follows: 

letrec  letrec 

Xi  =  Ci;  a:J  =  ei;    ...    a;/  '  =  ei; 

_       .  n  _       .  "»(!)  _ 

in    e  in    e' 

where  m[i)  is  the  nimiber  of  occurrences  of  x,  with  differently  monomorphic  instances  in  the 
expression  e,  and  e'  is  derived  from  e  by  replacing  the  j     occurrence  of  x,  with  differently 
monomorphic  instances  by  z^  for  all  1  <  i  <  n  cind  0  <  j  <  m{i). 
As  an  example,  consider  the  polymorphic  function  as  follows: 

f   X  y  z   =  letrec 

len  a  =  if  (null  a)  then  0  else  1  +  len  (cdr  a) ; 
sum  b  =  if  (null  b)  then  0  else  (car  b)  +  sum  (cdr  b) ; 
in 

if  (sum  y)*(len  y)  <  (sum  (car  z))*(len  z) 
then  X  else  (cdr  x) 

The  types  of  functions  f,  len,  and  sum  are 

f  :     Vq.    q  list  — »  int  list  —>  int  list  list  —>  a  list 

len     :     V/9.   /3  list  — >  int 
sum     :     \/7.   7  list  — ►  int 

Two  occurrences  of  the  letrec-bound  identifier  len  are  instantiated  to  different  types,  i.e. 

The  first  occurrence  of  len  :     V/3.   /3  list  — »  int  [  /?  =  int  ] 

The  second  occurrence  of  len     :     V/3.   (i  list  — »  int  [  (3  =  int  list  ] 

Thus,  we  transform  the  function  definition  of  f  into  as  follows: 

f   X   y   z   =   letrec 

len'  a  =  if  (null  a)  then  0  else  1  +  len'  (cdr  a); 
len''  a  =  if  (null  a)  then  0  else  1  +   len''  (cdr  a); 


139 


sum  b  =  if  (null  b)  then  0  else  (car  b)  +  sum  (cdr  b) ; 
in 

if  (sum  y)*(len'  y)  <  (sum  (car  2))*(len''  z) 
then  X  else  (cdr  x) 

III  order  to  get  some  polyinorpliically  invariant  information  about  the  polymorphic  function 
f ,  we  find  the  simplest  monomorphic  instance  of  f  and  analyze  that  function  using  the 
monomorphic  analysis.  As  a  simplest  monomorpliic  instance,  we  let  q  =  int.  Then,  the 
monotypes  of  functions  f ,  len',  len'  '  and  sum  are 


f 

len' 
len'  ' 
sum 


int  list  — »  int  list 

int  list  — ♦  int 

int  list  list  —>  int 

int  list  — >  int 


int  list  list  — ♦  int  list 


Then,  we  apply  the  analysis  for  monomorphic  languages  to  this  trcinsformed  functions. 
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Chapter  7 

Extensions  to  Non-strict 
Languages 


So  far  in  the  previous  chapters  we  have  discussed  a  set  of  escape  analyses  for  higher-order 
functional  languages  with  strict  semantics.  Many  modern  functional  languages,  however, 
adopt  a  non-strict  semantics  and  use  the  lazy  evaluation  model.  These  languages  are  more 
powerful  than  strict  languages  in  expressiveness  but  requires  quite  a  different  kind  of  im- 
plementation  model. 

In  this  chapter,  we  extend  the  escape  analysis  and  the  reference  escape  analysis  for  a 
strict  language  to  a  non-strict  language.  First,  we  describe  a  method,  based  on  a  source-to- 
source  transformation  of  non-strict  programs,  to  extend  the  escape  analysis  and  the  reference 
escape  analysis  for  a  strict  language  to  a  non-strict  language  with  normal- order  evaluation 
using  the  analysis  techniques  for  a  strict  language.  The  lazy  evaluation  model  is  identical 
to  the  normal-order  evaluation  model  in  the  standard  semantics,  but  not  in  an  operational 
semantics.  In  lazy  evaluation,  arguments  to  a  function  are  not  evaluated  unless  and  until 
their  values  are  demanded,  and  are  evaluated  only  once  upon  the  first  demand.  Their  values 
are  then  saved  to  be  used  for  subsequent  demands,  thus  avoiding  reevaluation.  Using  the 
order-of-demand  analysis  described  in  Chapter  5,  we  extend  the  escape  and  reference  escape 
analyses  to  non-strict  functional  languages  using  lazy  evaluation.  Finally,  the  extension  for 
a  non-strict  language  using  optimized  lazy  evaluation  based  on  the  strictness  information 
is  discussed. 
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7.1      Escapement  under  Normal-Order  Evaluation 

Two  methods  are  used  for  implementing  non-strict  semantics:  either  a  normal-order  (call- 
by-name)  evaluation  or  a  lazy  (call-by-need)  evaluation.  In  a  non-strict  semantics  with 
normal  order  evaluation,  all  arguments  to  a  function  are  passed  to  the  function  in  an 
imevaluated  form  and  are  only  evaluated  whenever  needed  inside  the  function  call.  In  order 
to  achieve  normal  order  evaluation,  the  following  two  mechanisms  are  required: 

1.  A  mechanism  to  delay  or  suspend  the  evaluation  of  expressions  when  their  evaluated 
values  are  not  needed  immediately;(for  example,  when  expressions  are  passed  to  some 
non-strict  function.) 

2.  A  mechanism  to  force  the  evaluation  of  suspended  expressions  when  their  values  are 
needed;  (for  example,  when  they  are  passed  to  some  strict  function.) 

On  a  conventional  machine,  normcd-order  evaluation  is  effected  by  creating  a  closure,  called 
thunk,  consisting  of  some  code  along  with  bindings  for  its  free  variables,  to  represent  a  de- 
layed expression.  These  thunks  must  generaUy  be  allocated  in  the  heap  and  their  evaluation 
requires  a  function  call  to  force  the  evaluation. 

In  general,  we  can  simulate  a  non-strict  language  using  a  strict  language  by  the  intro- 
duction of  explicit  delays  and  forces.  A  way  to  simulate  normal-order  evaluation  is  to  insert 
some  code  to  delay  the  evaluation  of  any  expression  which  will  not  be  immediately  needed, 
including  all  arguments  passed  to  user-defined  functions,  and  to  insert  appropriate  code  to 
force  the  evciluation  of  the  delayed  expression  when  they  are  needed.  It  is  possible  to  repre- 
sent delayed  expressions  by  using  the  same  closures  which  are  used  for  representing  function 
values.  Given  an  argument  expression  e,  we  can  use  beta-abstraction  to  translate  e  into  the 
expression  (Az.e)  y  for  any  y  provided  neither  x  nor  y  occur  free  in  e.  For  convenience,  we 
define  as  follows: 

•  ()  denotes  a  void  identifier 

•  []  denotes  a  dummy  expression. 

Then  we  can  write  this  as  (A().e)  []  without  having  to  worry  about  naming  problem.  When- 
ever the  value  of  e  is  required,  we  have  to  explicitly  force  the  evaluation  of  e.  To  do  this,  we 
have  to  apply  the  closure  for  c  to  a  dunmiy  argument.  This  forcing  is  only  required  to  be 
done  when  the  value  of  the  expression  is  actually  needed.  The  delay  and  force  operations 
can  be  implemented  by  a  strict  language  as  follows: 
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DELAY   exp   =   IcimbdaO.    exp      /*    create   delayed   expression   */ 
FORCE  delayed.exp   =    (delayed_exp    [] )      /♦    evaluation  */ 

Thus,  in  general,  any  non-strict  language  can  be  simulated  by  a  strict  language  through  a 
source-to-source  transformation  of  non-strict  programs  into  their  strict  coiinterparts. 

Since  the  operational  semantics  of  a  strict  language  is  not  equivalent  to  that  of  its  non- 
strict  counterpart,  the  escapement  under  non-strict  semantics  with  normal-order  evaluation 
becomes  different  from  the  escapement  under  strict  semantics.  As  an  example,  consider  the 
following  non-strict  (using  normal-order  evaluation)  program: 

letrec      f    x   y  =   x-^y; 

g   a   =  if    (a=0)    then    (f    a)    else    (f    3)  ; 

h   c   d      =   g    (c-^d)  ; 
in        ... 

Consider  the  escapement  of  the  parameters  c  and  d  from  the  function  h.  In  a  strict  language, 
during  the  execution  of  h's  body,  the  expression  (c-^d)  will  be  evaluated  before  g  is  applied 
to  it,  and  therefore  neither  c  or  d  escape  from  h.  However,  in  a  non-strict  language,  during 
the  execution  of  h's  body,  a  closure  representing  the  delayed  expression  (c+d)  will  be  created 
and  passed  to  g.  During  the  execution  of  g's  body,  the  closure  is  passed  to  f  and  thus  both 
c  and  d  may  escape  from  h  within  the  closure  representing  the  partial  application  of  f . 

Consider  the  escapement  of  references  associated  with  occurrences  of  the  parameters  c 
and  d  from  their  function  h.  When  h  is  called,  its  activation  record  contains  two  references, 
corresponding  to  the  parameters  c  and  d.  to  the  actual  arguments.  The  actual  param- 
eters are  themselves  closures.  During  the  evaluation  of  the  body  of  h,  when  (g  (c+d)) 
is  evaluated,  a  closure  is  created  for  (c+d).  The  references  corresponding  to  c  and  d  are 
n  pied  into  the  closure.  Then,  the  reference  to  this  closure  is  copied  into  the  activation 
record  for  g.  During  the  execution  of  g's  body,  this  reference  is  passed  to  f  and  thus  both 
references  associated  with  c  and  d  may  escape  from  h  within  the  closure  representing  the 
partial  application  of  f . 

Property  7.1  (Non-strict  Escape  Property)  In  the  normal-order  evaluation  model, 
given  an  expression  exp,  the  escape  semantic  value  of  exp  when  its  evaluation  is  delayed, 
has  the  following  properties: 
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•  The  first  component  of  the  escape  semcintic  value  of  exp  is  the  least  upper  bound  of 
the  first  components  of  the  escape  semantic  values  of  all  identifiers  in  ezp,  because 
when  exp  is  eventually  evaluated,  the  values  of  all  identifiers  in  exp  will  be  needed. 

•  The  second  component  of  the  escape  semantic  value  of  exp  is  err  because  the  delayed 
exp  itself  is  not  a  function  type  and  thus  it  can  not  be  applied  directly  to  any  argimient. 

•  The  escape  semantic  value  of  exp  must  be  retained  somehow  in  order  to  represent  the 
escape  semantic  value  when  exp  is  evaluated. 

7.1.1  Program  Transformation 

Thus,  the  escape  analysis  and  the  reference  escape  analysis  for  a  non-strict  functional  lan- 
guage can  be  achieved  by  first  transforming  non-strict  programs  into  ecjuivalent  strict  pro- 
grams and  then  by  applying  the  analyses  to  the  transformed  programs.  The  source-to-source 
transformation  fimction  N  of  type  Exp  -^  Powerset(/(f)  — ►  Exp  for  non-strict  programs  is 
defined  in  Figure  7.1. 

7.1.2  Using  Escape  Analysis  for  Strict  Languages 

The  abstract  escape  semantic  function  O^  for  a  dummy  expression  []  is  defined  as  follows: 

OM     =     (0,err) 

Global  Non-strict  Escape  Test 

We  describe  a  global  escape  test  for  non-strict  functions.  Given  a  non-strict  function 
f  Xx  X2  ■  ■ .  Xn  =  bodyj  of  arity  n,  the  position  i  of  an  interesting  parameter,  and  an 
abstract  escape  semantic  environment  eriVg  mapping  a  transformed  version  of  /  to  an  ele- 
ment of  Do,  the  global  non-strict  escape  test  function  G_n.escape?  determines  whether  the 
z"'  parameter  of  the  non-strict  function  /  could  possibly  escape  /  globally  or  not.  It  is 
defined  as  follows: 

G_n_escape?(/,  z,  ehVo)  =  (0^1/'  ii    •  •  ■  ZnJ  enVo[z,  ^  yi\)(i) 
where  /'  is  a  transformed  version  of  /, 

y.  =  (l,A().(l,M^^-)), 
for  all  j  <  n  and  j  ^  i, 

j/,  =  (0,A().(O.H--», 
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N[clF/d  =>     \{).c 

Nfxl  Fid  =>     i{{x  e  Fid)  then  x  else  {x  []  ) 

ISy^  +  e^j  Fid     =>     (N[eil  F7d)  +  (N|e2l  F/d) 

/*  same  for  strict  operators  like  (ei  —  €2)  and  (ci  =  62)  */ 
Nlif  ei  then  63  else  63]  F/d     =>     if  (N[ei]  Fid) 

then  (N[e2l  ■f'^^) 
else  (Nlesl  Fid) 
Nleie2l  F7(f  =>     if  Ci  e  {   car,    cdr   } 

then  /*  strict  operator  */ 
(Nieil  Fid)   (N|e2l  Fid) 
else  /*  non-strict  operator  */ 
me,}  Fid)   (A().N[e2lF/d) 
N|lainbda(a;).el  Fid     =>     lambda(a').(N|el  Fid) 
N|letrec  Zi  =  Ci; . .  .2„  =  e„;  in  e]  Fid     =>     letrec 

X,  =N[e:I(F/dU{xi,...,3:„}); 

x„  =  N|e„I(F/(fu{xi,...,x„}); 

in 

Nleil(F/dU{xi,...,z„}) 

Nplprj     -     N[prl0 

Figure  7.1:  Non-strict  Program  Transformation 
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and  T,  is  the  type  of  the  i""  parameter  of  /.  Then,  from  the  result  of  the  global  non-strict 
escape  test  function,  we  can  conclude  as  follows: 

•  If  G_n_escape?(/,  f,  envo)  =  0  then  we  conclude  that  in  any  possible  application  of  a 
non-strict  f  to  n  arguments,  the  i"*  delayed  argument  does  not  escape  /. 

•  If  G_n_escape?(/,  z,  ehvo)  =  1  then  it  means  that  the  t'''  delayed  argument  couW escape 
/  in  some  possible  application  of  a  non-strict  /  to  n. 

Local  Non-strict  Escape  Test 

We  describe  a  local  escape  test  for  non-strict  fimctions  in  a  particular  context.  Given  a  non- 
strict  function  f  Xi  x-^  ■  ■  ■  x^  =  bodyf  of  arity  n  in  an  application  /  ej  ...  e„,  the  position 
2  of  an  interesting  parameter,  and  an  abstract  escape  semantic  environment  envo  mapping 
a  transformed  version  of  /  and  the  free  identifiers  within  e-i  through  €„  to  elements  of  Do-, 
the  local  non-strict  escape  test  function  L_n .escape?  determines  whether  the  f'''  parameter 
of  the  non-strict  function  /  could  escape  /  during  the  evaluation  of  /  cj  ...  e„.  It  is  defined 
as  follows: 

L_n_escape?(/,z,  ei,...,e„,eni;o)  =  {O^f  Xi   . . .  x„]  enVo[xi  ^  t/i])(i) 
where  /'  is  the  transformed  version  of  /, 

t/,  =  (l,A().(l,(6e[e,lent'o)(2))), 

and  for  all  j  <  n  and  j  -^  i, 

J,,  =  (0,A().(0,(64e,len,;„)(2))). 

Then,  from  the  result  of  the  local  non-strict  escape  test  fimction,  we  can  conclude  the 
following: 

•  If  L_n_escape?(/,  2,  ei, . . .,  e„,  eriUo)  =  0  then  we  conclude  that  the  ;'''  delayed  argu- 
ment does  not  escape  /  locally  in  the  particular  application  of  /  to  ej  through  €„. 

•  If  L_n_escape?(/,  i,  ei,. .  .,e„,  enVo)  =  1  then  it  means  that  the  i'''  delayed  argument 
could  escape  /  locally  in  the  particular  application  of  /  to  ej  through  £„. 

7.1.3      Using  Reference  Escape  Analysis  for  Strict  Languages 

The  abstract  reference  escape  semantic  function  Re  for  a  dununy  expression  []  is  defined 
as  follows: 

A'rIQI     =     ((0,0),  err) 
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Global  Non-strict  Reference  Escape  Test 

Given  a  non-strict  function  f  Xi  X2  . .  •  Zn  =  bodyj  of  arity  n,  the  position  (i.j)  of  an  in- 
teresting occurrence  of  a  parameter,  and  an  abstract  reference  escape  semantic  environment 
enVr  mapping  the  auxiliary  function  of  the  transformed  version  of  /  to  an  element  of  Dr, 
the  global  non-strict  reference  escape  test  function  G_n_refescape?  determines  whether  the 
reference  associated  with  the  j""  occurrence  of  the  z"'  parameter  of  the  non-strict  function 
/  could  escape  /  globally.  It  is  defined  as  follows: 

G-n-refescape?(/,  z,  j,  eni^r)  = 

{Relf"  xi   ...  a;io(i)  .  . .  z„   ...  a;no(n)l  envrif"  ^^  /",  z,j  ^  2/u])(i)(i) 

where  /"  is  an  auxiliary  function  for  /',  /'  is  a  transformed  function  of  /, 
/"  =  R.lf'jenvr, 

y,,  =  ((1,0),A().((1,0),M^^-)), 
for  all  k  <  o(i)  and  h  ^  j, 

2/,,  =  ((0,0),A().((0,0),VF^-)), 
for  all  1  <  m  <  o(/)  and  /  /  i, 

yim  =  {{0,0),  X{).{{0,0),W^')), 

and  r,  is  the  type  of  the  z"*  parameter  of  /.  Then,  from  the  result  of  the  global  non-strict 
reference  escape  test  function,  we  can  conclude  as  follows: 

•  If  G.n_refescape?(/,  z,  J,  eTZi;^ )  =  0  then  we  conclude  that  in  any  possible  application  of 
a  non-strict  function  /  to  zi  arguments,  the  reference  associated  with  the  j  occurrence 
of  the  z      delayed  argument  does  not  escape  /. 

•  If  G-n_refescape?(/,  z,_/,  enur)  =  1  then  it  means  that  in  some  possible  application  of  a 
non-strict  function  f  to  n  arguments,  the  reference  associated  with  the  j""  occurrence 
of  the  z''"  delayed  argument  could  escape  /. 

Local  Non-strict  Reference  Escape  Test 

Given  a  non-strict  function  f  xi  X2  ■  ■  ■  Xr,  =  bodyj  of  arity  n  in  a  particular  function 
application  /  fj  ...  €„,  the  position  {i,j)  of  an  interesting  occurrence  of  a  parameter,  and 
an  abstract  reference  escape  semantic  environment  eirv-r  mapping  the  auxiliary  function  for 
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the  transformed  version  of  /  and  the  free  identifiers  within  ei  through  e„  to  elements  of  Dr, 
the  global  non-strict  reference  escape  test  function  L_n^refescape?  determines  whether  the 
reference  associated  with  the  j"*  occurrence  of  the  i""  parameter  of  the  non-strict  function 
/  could  escape  /  in  the  evaluation  of  /  ej   ...  e„.  It  is  defined  as  follows: 

L_n.refescape?(/,  i,  j,  Cj, . . . ,  e„,  ehVr)  = 

{Relf"  xi   ...  zi„(i)  ...  x„  ...  a:„„(„)I  envrif"  ^  /",  x,_,  ^  y.>])(i)(i) 

where  /"  is  an  auxiliary  fimction  for  /',  /'  is  a  transformed  function  of  /, 

/"  =  Reinehv,, 

t/„  =  ((l,0),A().((l,0),(^eMeni;.)(2))), 
for  all  k  <  o[i)  and  k  ^  j, 

Vik  =  ((0,0),A().((0,0),{^eIe,lent;,)(2))), 

and  for  all  1  <  m  <  o{l)  and  /  /  z, 

yim  =  ((0,0),A().({0,0),(^eMent-,)(2))). 

Then,  from  the  result  of  the  local  non-strict  reference  escape  test  function,  we  can  conclude 
the  following: 

•  If  L.n_refescape?(/,  z,j,  ci, . .  .,e„,eni'r)  =  0  then  we  conclude  that  the  reference  as- 
sociated with  the  j""  occurrence  of  the  f""  delayed  argument  does  not  escape  /  in 
(/ei   ...e„). 

•  If  L_n_refescape?(/,  f,_;',  Cj, . . .,  e„,  eni/r)  =  I  then  it  means  that  the  reference  associ- 
ated with  the  j""  occurrence  of  the  z""  delayed  argument  couW  escape  /  in  (/  ej   .'. .  e„). 

7.1.4      Examples 

As  an  example,  consider  the  following  non-strict  program: 

letrec      f    x   y   =   x+y; 

g   a   =    if    (a=0)    then    (f    a)    else    (f    3); 

h  c  d     =  g    (c+d); 
in        ... 

where  f ,  g,  h.  :  int  —>  int  -^  int.  The  transformed  functions  f .  g'  and  h'  for  f.  g  and  h, 
based  on  the  program  transform  function  N,  are  defined  as  follows: 
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letrec     f    x  y  =    (x    [] )   +    (y    [] ) ; 

g'    a  =   if    ((a    [])    =0)    then   (f    lambda().(a    [] ) ) 
else    (f    lambdaO.S); 

h'    c   d   =   g'    lambda().((c    []  )    +    (d    [] ) )  ; 
in        ... 

where  f '  ,    g'  ,   h'  :  (*  — *  int)  -^  (*  -+  int)  —»(*—»  int)  and  *  denotes  the  type  of  a  void 
identifier  and  a  dummy  expression. 

Non-strict  Escape  Information 

The  definitions  of  the  escape  semantic  values  /',  </',  and  h'  off,  g',  and  h'  are  expressed 
as  follows: 

/'     =  {0,\x.{x^,),\y.{0,err))) 

g'     =  (0,Aa.(/('2)(a(i),A().a(0,err))u(/('2)(0,A().(0,err)))) 

=  (0,Aa.(/,'2,(a(i),A().a(0,err))) 

h'     =  (0,Ac.(c(i),A(f.5('2)((c(i)Ud(i)),A().(0,err)))) 

Let  envo  =  [f  h^  /',g'  i->  5',h'  ^--  h']. 

To  find  the  global  escape  property  of  the  non-strict  function  h,  we  apply  the  non-strict 
global  escape  test  function  G_n_escape?  as  follows: 

G_n_escape?(h,  IjCnUo)     =     (Oefh'    c   d]env'o)(j) 

=     1 

where 

env'^  =  env,[c  ^  (1,  A().(l,  Vy('^'"')^(*^'"'))),d  h^  (0,  A().(0,  W^(*^'"'>^(*^'"')))] 

and 

^(_.„0^(.^mt)  ^  Ax.(x(i),A2/.i(i)Uy(a),erT)). 

Then,  we  can  conclude  that  the  first  parameter  c  of  the  function  h  could  escape  h  globally. 
Similarly, 

G_n^escape?(h,  2,  enVo)     =     (Oe[h'    c   d]env'o)(\) 

=     1 

where 

env'o  =  envo[c^  (0,  A().(0,  H^'-^""'-(*^'"")),d  h^  (1,  A().(1,  H/(*^'"')-(— mO))] 
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and 

^(,^.„,H(.-nO  =  Ax.(x(i),  Ay.;r(i,  U  y^,,  err)). 
Thus,  we  can  conclude  that  the  second  parameter  d  of  the  function  h  could  also  escape  h. 

Non-strict  Reference  Escape  Information 

The  definitions  of  the  reference  escape  semantic  values  /',  g\  and  /i'  of  f ,  g',  and  h'  are 
expressed  as  follows: 

/'     =  {{Q,Q),\x.{x^,y\y.{{0,0),err))) 

g'     =  ((0,0),Aa.(/,'3)(a(i),A().a((0,0),err))u(/,'3,  ((0,0),A().((0,0),e7-r)))) 

=  ((0,0),Aa.(/('2j  (a(i),A().a  ((0,0), err))) 

h'     =  ((0,0),Ac.(c(i),Arf.ff,',j((c(i)Ucf(i)),A().((0,0),err)))) 

The  auxiliary  functions  f '  ',  g'  '  and  h'  '  for  the  transformed  functions  f ,  g'  and  h'  are 
defined  as  follows: 

f"    X   y    =    (x    [])    +    (y    []); 

g'    al    a2   =    if    ((al    []  )    =   0)    then    (f    lambda().(a2    [] ) ) 

else    (f    lambda().3); 
h'    c  d  =  g'    lambda().((c    [] )    +    (d    [])); 

Then,  the  definitions  of  reference  escape  semantic  values  /",  </",  and  h"  of  f '  ',  g'  ',  and 
h'  '  are  expressed  as  follows: 

/"     =     ((0,0), Ax.(2'(i),Aj/.((0,0), err))) 

g"     =     ((0,0),Aal.(al(i,,A«2.(/,'2,(a2(i),A().a2(2)  ((0.0), err))) 

h"     =     ((0,0), Ac.(c(,).Ad.g[,)((c(i)Ud(i)).A().((0,0), err)))) 

Let  eni-,.  =  [f  ^^  f',f  ^  /",g'  ^  g',g"  ^  <7",h'  ^  /i',h"  .^  h"]. 

To  find  the  global  reference  escape  property  of  the  non-strict  function  h,  we  apply  the 
non-strict  global  reference  escape  test  function  G.n.refescape?  as  follows: 

G_n_refescape?(h,  1,  l.en^v)     =     [Rel'^' '    c   djeru'^ )(])(]) 

=     1 


where 


enrV  =  emv[c  H.  ((1.  0),  A().((l,  0),  VF(— ')-(—"")), 
d^  ((0,0),A().((0.0).VV(-^'""-'--'"')))l 
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Then,  we  can  conclude  that  the  reference  associated  with  the  first  occurrence  of  the  first 
parameter  c  of  the  function  h  could  escape  h  globally.  Similarly, 

G-n_refescape?(h,  2,  l,eni;r)     =     (^el^' '    c  d|enz;'r)(i)(i) 

=     1 

where 

env'r  =  ehvr\c  ^  ((0,  0),  A().((0, 0),  ^^(--'"'M— ^0))^ 
d  ^  ((1, 0),  A().((l,  0),  V7(— "O-C— 0))] 

Thus,  we  can  conclude  that  the  reference  associated  with  the  first  occiirrence  of  the  second 
parameter  d  of  the  function  h  coiild  also  escape  h. 

7.2      Escapement  under  Lazy  Evaluation 

The  demand-driven  evaluation  of  an  expression  in  a  non-strict  language  is  effected  by  creat- 
ing some  delayed  representation  which  contains  enough  information  to  enable  the  expression 
to  be  evaluated  later  when  needed.  In  particular,  this  requires  some  mechanism  for  creating 
the  delayed  expression  and  some  mechanism  for  forcing  its  evaluation.  A  naive  imple- 
mentation of  normal-order  reduction  would  residt  in  an  implementation  in  which  actual 
parameters  were  copied  as  they  were  bounded  to  formal  parameters  in  function  applica- 
tion. Using  this  strategy,  an  argimient  could  be  evaluated  several  different  times,  resulting 
in  some  inefficiency.  The  lazy  evaluation  model  is  an  efficient  implementation  method  in 
which  each  argument  is  computed  at  most  once.  In  a  non-strict  semantics  using  lazy  eval- 
uation, all  argimients  to  a  function  are  passed  to  the  fimction  in  aji  unevaluated  form  and 
are  evaluated  only  once  when  first  needed  inside  the  function  call.  Thus,  in  lazy  evaluation, 
some  other  mechanism  is  needed  to  avoid  the  recomputation  of  a  value.  In  addition,  the 
representation  of  the  delayed  expression  must  contain  the  code  to  be  evaluated  and  the  en- 
viroimient  in  which  to  evaluate  the  code.  In  order  to  effect  the  lazy  evaluation,  we  basically 
require  the  following  three  mechanisms: 

1.  A  mechanism  to  delay  or  suspend  the  evaluation  of  expressions  when  their  evaluated 
values  are  not  needed  immediately;(for  example,  when  expressions  are  passed  to  some 
non-strict  function.) 

2.  A  mechanism  to  force  the  evaluation  of  evaluation-suspended  expressions  when  the 
evaluated  values  of  evaluation-suspended  expressions  are  needed;  (for  example,  when 
they  are  passed  to  some  strict  function.) 
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3.  A  mechanism  to  avoid  the  re-evaluation  of  suspended  expressions  when  their  values 
are  needed  and  their  evaluations  have  already  been  forced. 

On  a  conventional  machine,  lazy  evaluation  is  effected  by  creating  a  rim-time  structure, 
called  self-modifying  thunk,  consisting  of  some  code  along  with  bindings  for  its  free  vari- 
ables, the  status  of  the  evaluation  and  the  value  when  already  evaluated,  to  represent  a 
delayed  expression.  These  self-modifying  thunks  must  generally  be  allocated  in  the  heap 
and  their  evaluation  requires  a  test  of  the  evaluation  status,  a  function  call  to  force  the 
evaluation,  and  an  update  with  the  evaluated  value.  Due  to  the  absence  of  side  eflTects 
of  functional  languages,  lazy  evaluation  is  equivalent  to  normal-order  reduction  under  the 
standard  semantics,  but  it  is  often  more  efficient  since  it  requires  no  recomputation.  We 
can  not  implement  a  lazy  evaluation  model  using  a  strict  pure  functional  language  because 
we  caimot  explicitly  overwrite  the  environmtent.  Lazy  evaluation  can  be  implemented  only 
through  the  use  of  side-effects.  One  way  of  implementing  the  lazy  evaluation  model  is  as 
follows: 

DELAY   exp   =    IcunbdaO  .    exp      /*    create   delayed  expression   */ 

FORCE  delayed.exp  =   if   already_evaluated?(delayed_exp) 

then  return  V;      /*   no   evaluation   */ 
else  V    :=   (delayed.exp    [] ) ;      /♦  evaluation  */ 

save  V   in  some  place; 

return   V; 

The  escapement  imder  a  non-strict  semantics  with  lazy  evaluation  is  not  equivalent  to 
the  escapement  under  a  non-strict  semantics  with  normal-order  evaluation,  because  their 
operational  semantics  are  different.  Consider  the  foUowing  program  as  before  but  with  lazy 
evaluation: 

letrec      f    x   y   =   x+y; 

g   a   =   if    (a=0)    then    (f    a)    else    (f    3); 

hod     =   g    (c+d); 
in        ... 

Consider  the  escapement  of  the  parameters  c  and  d  from  their  function  h.    As  described 
before,  in  a  non-strict  language  with  normal-order  evaluation,  a  closure  representing  the 
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delayed  expression  of  (c+d)  will  be  created  cind  passed  to  g  during  the  execution  of  h's 
body.  During  the  execution  of  g's  body,  this  closure  is  passed  to  f  and  thus  both  c  and  d 
may  escape  from  h  within  the  closure  representing  the  partial  application  of  f .  However, 
in  a  non-strict  language  with  lazy  evaluation,  a  closure  representing  the  delayed  expression 
of  (c+d)  will  be  created  amd  passed  to  g  during  execution  of  h's  body.  In  the  execution  of 
g,  the  delayed  expression  of  (c+d)  is  forced  to  be  evaluated  during  the  evaluation  of  (a=0) 
and  thus  neither  c  and  nor  d  will  escape  h. 

Consider  the  escapement  of  references  associated  with  occxirrences  of  the  parameters 
c  and  d  from  their  function  h.  When  h  is  called,  its  activation  record  contcuns  two  ref- 
erences, corresponding  to  the  parameters  c  and  d,  to  actual  parameters  which  are  self- 
modifying thunks.  During  the  evaluation  of  the  body  of  h,  when  (g  (c+d))  is  evaluated,  a 
self-modifying  thirak  is  created  for  the  delayed  evaluation  of  (c+d).  The  references  corre- 
sponding to  c  and  d  are  copied  into  the  self-modifying  thunk.  Then,  the  reference  to  this 
self-modifying  thunk  is  copied  into  the  activation  record  for  g.  During  the  execution  of 
g's  body,  this  self-modifying  thunk  is  actually  evaluated  via  (a=0)  and  the  result  value  is 
saved  in  the  self-modifying  thunk  for  later  demand.  When  the  value  of  this  self-modifying 
thunk  is  demanded  in  future,  the  value  saved  is  just  returned  without  further  evaluation. 
Thus,  even  if  this  self- modifying  thunk  is  passed  to  f  in  the  partial  application  to  f ,  both 
references  associated  with  c  and  d,  which  are  contained  in  the  self-modifying  thiuik,  do  not 
escape  from  h  because  they  are  no  longer  needed. 

Property  7.2  (Lazy  Escape  Property)  In  the  lazy  evaluation  model,  given  an  expres- 
sion exp,  the  escape  semantic  value  of  exp  when  its  evaluation  is  delayed,  has  the  following 
properties: 

•  The  first  component  of  the  escape  semantic  value  of  exp  is  the  least  upper  bound  of 

1.  the  least  upper  bound  of  the  first  components  of  the  escape  semantic  values  of 
all  identifiers  in  exp  that  have  not  yet  been  evaluated. 

2.  the  least  upper  bound  of  the  first  components  of  the  escape  semantic  values 
of  all  identifiers  in  exp  that  have  been  already  evaluated,  because  when  exp  is 
eventually  evaluated  the  vadues  of  all  identifiers  in  exp  are  needed. 

•  The  second  component  of  the  escape  semantic  value  of  exp  is  err  because  exp  itself  is 
not  a  function  type  and  thus  it  can  not  be  applied  directly  to  any  argument. 

•  The  escape  semantic  value  of  exp  must  be  retained  somehow  in  order  to  represent  the 
escape  semantic  value  when  exp  is  evaluated. 
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Thus,  information  about  evaluation  status  is  useful  for  the  escape  analysis  and  the  reference 
escape  analysis  of  a  non-strict  functional  language  with  lazy  evaluation. 

7.2.1  Using  Status-of-Evaluation  Information 

Information  on  the  evaluation  status  of  arguments  to  a  function  when  they  are  demanded  is 
useful  for  describing  the  escapement  behavior  under  lazy  evaluation.  Given  an  occurrence 
Xi  of  a  variable  x  in  the  body  of  a  function  /,  if  there  exists  another  occurrence  Xj  of  x 
such  that  Xj  is  demanded  before  Xi  in  each  possible  execution  of  the  body  of  /  then  we  say 
that  Xi  has  an  evaluated  status.  This  means  that  x  must  already  have  been  evaluated  by 
the  time  Xi  is  encountered.  Information  about  the  evaluated  status  of  an  occurrence  of  a 
parameter  of  a  function  can  be  inferred  at  compile-time  using  the  order-of-demand  analysis 
described  in  Chapter  5. 

For  example,  consider  the  following  function: 

g   a   =   if    (a=0)    then    (f   a)    else    (f    3); 

Let  the  two  occurrences  of  the  parameter  a  in  the  body  of  the  function  g  be  a'  and  a'  ' 
from  left-to- right,  respectively.  The  occurrence  a'  '  has  an  evaluated  status,  because  the 
argument  a  is  evaluated  before  it  is  demanded  via  a'  '  due  to  the  demand  via  the  occurrence 
a'. 

7.2.2  Escape  Analysis  for  Lazy  Evaluation 

The  abstract  escape  semantic  domain  Do  (^n  abstraction  of  Do),  and  the  domain  Eo  of 
abstract  escape  environments  are  defined  as  follows: 

Do     =     y^^o  /*  Abstract  escape  semantic  domain  */ 

T 

Eo     =     Id  —>  Do     I*  Domain  of  abstract  escape  enviroimients  */ 

£)mt  _  5o  X  {err}  abstract  subdomain  for  integers 

£)6oo(  _  Bo  y-  {err}  abstract  subdomain  for  booleans 

Dp ^""2  =  5o  X  (Z)p  -^  Do')  abstract  subdomain  for  functions 

£)T,  hst  _  ^T,  abstract  subdomain  for  lists 

The  abstract  escape  semantic  functions  are  as  follows: 

Oc       :     Con  -*  Do  I*  Abstract  escape  semantic  function  for  constants  */ 

Oe       :     Exp  ^  Eo  -^  Do     I*  Abstract  escape  semantic  function  for  expressions  */ 
Opr     ■     Program  ^  Do       /*  Abstract  escape  semantic  function  for  programs  */ 
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OM  =  i^^^rr) 

Oclc]  =  (Cerr),    cG  {..., -1,0,1, ...,true,false} 

OJnil^'"'!  =  Ir  (The  bottom  element  of  Do-) 

0<.[cons|  =  (0,Ax.(a;(i),Ay.a;Uy)) 

Oclcarl  =  {0,\x.x) 

Oc[cdr]  =  {0,Xx.x) 

Oclnulll  =  (O,Ai.(0,  err)) 

Oelcjenvo  =     Oclcj 

OelxjefiVo  =     ehvolxj 

Oe[ei  +  e2JenVo     =     (0,  err)  /*  same  for  ei  -  62  and  ei  =  62  */ 

Oe|if  ei  then  62  else  eajenwo     =     [Oeleijenvo)  U  {Oele2JeTiVo) 

Oeleie2}ehvo     =     {Oe[ei}enVo)^2)  {Oele2ienVo) 

6^llaiabd&{x).ejehvo     =     {V,  Xy.Oele}eriVo[x  >-^  y]) 

where 

y  =  OU(        U        (ent;4zl)(i))U(     |J     (0^1  (z  [])  lent;„)(i,), 

F  =  Set  of  free  identifiers  in  (lambda(a;).e),  and 
pevai  _  ggj  QJ-  fj.gg  identifiers  with  an  evaluated  status. 

Oe|letrec  zi  =  ei;...x„  =  e„;in  ejenvo     =     Oelejefiv'^ 

where  env^  =  enVo[xi  h^  Oelejenv^, . . . ,  !„  h^  Oelcnleni'^] 

OprlpT-l     =     Oelprjnulienvo 

Figure  7.2:  Abstract  Escape  Semantic  Functions  for  Lazy  Evaluation 


155 


The  definitions  of  the  abstract  escape  semantic  functions  are  given  in  Figure  7.2.  Note  that 
the  definition  of  the  abstract  escape  semantic  function  O^  for  lambda  expressions  of  the 
form  lambda(x).e  treats  free  identifiers  differently  according  to  their  evaluation  status. 

Global  Lazy  Escape  Test 

We  describe  a  global  escape  test  for  lazy  functions.  Given  a  lazy  function  /  xi  Z2  •  ••  ^^n  = 
bodyj  of  arity  n,  the  position  i  of  an  interesting  parameter,  an  abstract  escape  semantic 
environment  enVo  mapping  a  transformed  version  of  /  to  an  element  of  D^,  the  global  lazy 
escape  test  function  G-Lescape?  determines  whether  the  z""  parameter  of  the  lazy  function 
/  could  possibly  escape  /  globally  or  not.  It  is  defined  as  foUows: 

GJ.escape?(/,  i,  efiv„)  =  [O^lf  x^   . . .  x„}  enVo[xi  •->  y.])(i) 

where  /'  is  a  transformed  function  of  /, 

for  all  J  <  n  and  j  ^  f, 

3/,  =  (0,A().(0,l^^-)), 

and  Ti  is  the  type  of  the  z'"'  parameter  of  /.  Then,  from  the  result  of  the  global  lazy  escape 
test  function,  we  can  conclude  as  follows: 

•  If  G_l_escape?(/,  2,  ent;o)  =  0  then  we  conclude  that  in  any  possible  application  of  a 
lazy  function  f  to  n  arguments,  the  z"'  delayed  argument  does  not  escape  /. 

•  K  G_Lescape?(/,  z,  efii'o)  =  1  then  it  means  that  the  z"'  delayed  argument  could  escape 
f  in  some  possible  application  of  a  lazy  function  /  to  zz. 

Local  Lazy  Escape  Test 

We  describe  a  local  escape  test  for  lazy  functions  in  a  particular  context.  Given  a  lazy 
function  /  x^  X2  .  ■ .  x^  =  bodyf  of  arity  n  in  an  application  context  f  e\  ...  e„,  the 
position  z  of  an  interesting  parameter,  and  an  abstract  escape  semantic  environment  eiiVo 
mapping  a  transformed  version  of  /  and  the  free  identifiers  within  Ci  through  £„  to  elements 
of  bo,  the  local  lazy  escape  test  function  LJ_escape?  determines  whether  the  z"*  parameter 
of  the  lazy  function  /  could  escape  /  in  the  evaluation  of  /  ei  ...€„.  It  is  defined  as 
follows: 
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LJ_escape?(/,  z,ei,...,e„,eni;o)  =  (Oe[/'  xi   . . .  x^,]  enVo[xi  h-,  2/,])(i) 
where  /'  is  a  transformed  function  of  /, 

y.-  =  (l,A().(l,(0eIe.leni-„)(2))) 
and  for  ail  j  <  n  and  j  /  i, 

J/,  =  (0,A().(0,(O,[e,leni;„)(2)». 
Then,  from  the  result  of  the  local  lazy  escape  test  function,  we  can  conclude  the  following: 

•  If  LJ-escape?(/,  i,  ei, . . .,  e„,  envo)  =  0  then  we  conclude  that  the  i""  delayed  argument 
does  not  escape  /  in  the  particular  application  of  /  to  Cj  through  £„. 

•  K  L_l_escape?(/,  z,  ei,  ...,€„,  enuo)  =  1  then  it  means  that  the  i"*  delayed  argimient 
could  escape  /  in  the  particular  apphcation  of  /  to  ej  through  e„. 

7.2.3      Reference  Escape  Analysis  for  Lazy  Evaluation 

The  abstract  reference  escape  semantic  domain  D^  and  the  domain  Er  of  the  abstract 
reference  escape  envirorunents  are  defined  as  follows: 

Dr     =     y^^r  /*  Abstract  reference  escape  semantic  domaiin  */ 

T 

Er     =     Id  ^  Dr     I*  Domain  of  abstract  reference  escape  envirormients  */ 

£)|."'  =  5r  X  {err}  abstract  subdomain  for  integers 

£fbool  _  B^  X  {err}  abstract  subdomain  for  booleans 

£)Ti-.T2  _  ^r  y.  [D^^  —*  Dr^)  abstract  subdomain  for  functions 

£)T  ii3t  _  £)T  abstract  subdomain  for  lists  of  typer  list 

We  now  introduce  the  abstract  reference  escape  semantic  functions  to  give  the  syntax  the 
reference  escape  meaning  as  follows: 

Con  — >  Dr  I*  Abstract  reference  escape  fimction  for  constants  */ 

Exp  ^  Er  ^  Dr     /*  Abstract  reference  escape  function  for  expressions  */ 
Program  -^  Dr       /*  Abstract  reference  escape  function  for  programs  */ 

The  semantic  equations  for  the  abstract  reference  escape  semantic  functions  are  given  in 
Figure  7.3.  Note  that  the  definition  of  the  abstract  reference  escape  semantic  function  Re 
for  lambda  expressions  of  the  form  lambda(2').e  treats  free  identifiers  differently  according 
to  their  evaluation  status. 
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Re 

Re 

R 


p^ 


Rclcj 

J?c|riullJ 


=  ((0,0),  err) 

=  ((0,0), err),    c  e  {. . ., -1,  0, 1, . . .,  true,f  alse} 

=  ±r  (The  bottom  element  of  Z?,..) 

=  ((0,0),Ai.(i(i),Aj/.rUT/)) 

=  ((0,0),Ax.cut^(^)) 

=  {{Q,0),Xx.x) 

=  ((0,0), Az.((0,0), err) 


R^cjefiv,  =     R^lcj 

RelxjefiVr  =     envrixj 

Relei  +  e2J€nVr     =     ((0,  0),  err)  /*  same  for  Ci  -  ez  and  ej  =  ej  */ 

^elif  ei  then  62  else  esjenv^     =     (R^leijefiVr)  U  (R^le2JenVr) 

Reieiezjenv,     =     {Releijefiv,)^2)  {Rele2}env,) 

^e|lambda(a;).e]enu,.     =     {V ,  Xy.R^lejehVr{x  ^  y]) 

where 

y=(0,0)u(        U       {env4zj\,^)u{     \J     [O^  [z  [])  iefiv^)^,^) 

F  =  Set  of  free  identifiers  in  (lambda(z).e),  and 

F^""-   =  Set  of  free  identifiers  with  an  evaluated  status. 

i^effletrec  s,  =  ej;  . .  .i„  ==  e„;  in  elenu,     =     Relejenv'^ 

where  env'^  =  envr[x^  ^  R^eijenvl, . .  .,Xr,  ^  R.le^env'^] 

^prlprj     =     R^lprjuullenvr 


Figure  7.3:  Abstract  Reference  Escape  Semantic  Functions  for  Lazv  Evaluati 
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Global  Lazy  Reference  Escape  Test 

Given  a  lazy  function  f  xi  X2  ■  ■  ■  x^  =  bodyf  of  arity  n,  the  position  (i,  j)  of  an  interesting 
occurrence  of  a  parameter,  and  an  abstract  reference  escape  semantic  environment  envr 
mapping  an  auxiliary  function  for  a  transformed  version  of/  to  element  oi  D^,  the  global  lazy 
reference  escape  test  function  G.Lrefescape?  determines  whether  the  reference  associated 
with  the  j^^  occurrence  of  the  i""  parameter  of  the  lazy  function  /  could  escape  /  globally 
It  is  defined  as  follows: 

G_Lrefescape?(/,  z,_/,  enur)  = 

(Relf"  xi   ...  a;i„(i)  ...  Xrt  ...  x„o(n)l  enVr[f"  ^  /",  Xij  ^  2/ij])(i)(i) 

where  /"  is  an  auxiliary  function  for  /',  /'  is  a  transformed  function  of  /, 

f"  =  R^lf'jefiv^, 

t/.,  =  ((1,0),A().((1,0),W^--)), 

for  clU  k  <  o(i)  and  k  7^  _;', 

3/,,.  =  ((0,0),A().((0,0),M^^O), 
and  for  all  1  <  tti  <  o(/)  and  /  /  i, 

j/,^  =  ((0,0),A().((0,0>,iy^')>, 

and  T,  is  the  type  of  the  z"'  parameter  of  /.  Then,  from  the  result  of  the  global  lazy  reference 
escape  test  function,  we  can  conclude  the  following: 

•  If  G_l_refescape?(/,  z,  j,  e/nv)  =  0  then  we  can  conclude  that  in  any  possible  application 
of  a  lazy  function  /  to  n  arguments,  the  reference  associated  with  the  _/'  occurrence 
of  the  z""  delayed  argument  does  not  escape  the  function  /. 

•  If  G_l-refescape?(/,  z,  j,  enUr )  =  1  then  it  means  that  in  some  possible  application  of 
a  lazy  function  /  to  n  arguments,  the  reference  associated  with  the  j  occurrence  of 
the  z      delayed  argument  could  escape  the  function  /. 

Local  Lazy  Reference  Escape  Test 

Given  a  lazy  function  f  X\  X2  ■  ■  ■  x^  =  bodyf  of  arity  n  in  an  application  /  cj  ...  e„,  the 
position  (z',_;)  of  an  interesting  occurrence  of  a  parameter,  and  an  abstract  reference  escape 
semantic  environment  crii\  mapping  an  auxiliary  function  for  a  transformed  version  of  / 
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and  the  free  identifiers  within  c;  through  e^  to  elements  of  Dr,  the  global  lazy  reference 
escape  test  function  L.Lrefescape?  determines  whether  the  reference  associated  with  the  j''' 
occurrence  of  the  i"*  parameter  of  the  lazy  function  /  could  escape  /  in  the  evaluation  of 
/  Ci   ...  e„.  It  is  defined  as  follows: 

L J-refescape?(/,  i, ;,  Cj, . . . ,  e„,  envr)  = 

{Re\f"  Xi    ...    2i„(i)    ...    Xn    ...    X^„(^)\  eilV^[f"  ^   /",  1,^  H^   yu])(l)(l) 

where  /"  is  an  auxiliary  function  for  /',  /'  is  a  transformed  function  of  /, 

/"  =  RAf'¥nv,. 

Vij  =  ((l,0),A().((l,0),(^e[eilen7;O(2))), 
for  all  A;  <  o(i)  and  k  ^  j, 

Vik  =  ((0,0),A().((0,0),(^eIeilen^.)(2))), 
and  for  all  1  <  tti  <  o{l)  and  /  /  i, 

yirr.  =  ((0,0),A().((0,0),(i?ehlent;,)(2)))- 

Then,  from  the  result  of  the  local  lazy  reference  escape  test  function,  we  can  conclude  the 
following: 

•  If  LJ-refescape?(/,  z,j,  ej,  ...,€„,  enUr)  =  0  then  we  conclude  that  the  reference  as- 
sociated with  the  j"'  occurrence  of  the  i""  delayed  argument  does  not  escape  /  in 
(/ei   ...  e„). 

•  If  L_l_refescape?(/,  i,  J,  ej, . . .,  e„,  eni;^)  =  1  then  it  means  that  the  reference  associated 
with  the  j""  occurrence  of  the  z'""  delayed  argument  could  escape  /  in  (/  ej    ...  e„). 

7.2.4      Examples 

As  an  example,  consider  the  following  non-strict  (with  lazy  evaluation)  program: 

letrec      f    x   y   =   x+y; 

g   a   =    if    (a=0)    then    (f    a)    else    (f    3); 

h   c   d      =   g    (c+d)  ; 
in        ... 

where  f ,  g,  h  :  int  ^  ini  -^  int.  The  transformed  functions  f '.  g'  and  h'  for  f.  g  and  h, 
based  on  the  program  transformation  function  N,  are  defined  as  follows: 
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letrec  f  x  y  =  (x  [] )  +  (y  [] ) ; 

g'  a  =  if  ((a  [])  =  0)  then  (f  lambdaO  .  (a  [])) 
else  (f  lambda().3); 

h'  c  d  =  g'  lainbda().((c  [] )  +  (d  [])); 
in   .  . . 

where  f '  ,  g'  ,  h'  :  (*  — >  int)  —►(*—>  int)  —»(*—+  int)  and  *  denotes  the  type  of  a 
void  identifier  and  a  dummy  expression.  Note  that  the  occurrence  of  g's  parameter  a  in  the 
expression  (f  '    lambdaO  .  (a    [] ) )  has  an  evaluated  status. 

Lazy  Escape  Information 

The  definitions  of  the  abstract  lazy  escape  semantic  values  /',  g',  and  h'  of  f ',  g',  and  h' 
are  expressed  as  follows: 

/'     =  {0,Xx.{x^,),Xy.{0,err))) 

g'     =  (0,Aa.(/('2)(0,A().a(0,e7-r))u(/('2)(0,A().(0,err)))) 

=  (0,Aa.(/('2)(0,A().a(0,e7-r))) 

h'     =  (0,Ac.(c(i),Ad.3('2)(('^(i)Ud(i)),A().(0,err)))) 

Let  envo  =  [f  i-^  /',g'  i->  g',h'  h^  h']. 

To  find  the  global  escape  property  of  the  lazy  function  h,  we  apply  the  lazy  global  escape 
test  function  G_l_escape?  as  follows: 

G.Lescape? (h,  1,  enfo)     =     (Oo|h'    c  d}env'o)(\) 

=     0 
where 

env'o  =  enu„[ci->  (1,  A().(0,  iy(— ""')-^(*^""'))), d  t-^  (0,  A().(0,  iy(-^'"')^(*^'"'))>], 

^(_.„tH(.^,„,)  ^  Xx.{x^,),  Ay.X(i)  U  7/(1),  err)). 

Similarly, 

G_l_escape?(h,2,eni'o)     =     (Oo[h'    c   djenv'a)(^i) 

=     0 
where 

env'o  =  envo[c^  (0,  A().(0,  iy(*^'"')^(*^'"'))),d  h^  (1,  A().(0,  Vy'*^'"')-'*-*'"')))], 
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Thus,  we  can  conclude  that  neither  the  first  parameter  c  nor  the  second  parameter  d  of  the 
function  h  escapes  h. 

Lazy  Reference  Escape  Information 

The  definitions  of  reference  escape  semantic  values  /',  g',  and  h'  of  f ,  g',  and  h'   are 
expressed  as  follows: 

/'     =  ((0,0),Ax.(x(,),A3/.((0,0),err))) 

g'     =  ((0,0),Aa.(/,'2)((0,0),A().a((0,0),err))u(/('2)<(0,0),A().{(0,0),erT-)))) 

=  ((0,0),Aa.(/('2,(a(i,,A().a((0,0),erT))) 

h'     =  ((0,0),Ac.(c(i),Ad.g('2)((c(i)Ucf(i)),A().((0,0),eri-)))) 

The  auxiliary  functions  f  ',  g'  '  and  h' '  for  the  transformed  functions  f ,  g'  and  h'  are 
defined  as  follows: 

f"    X  y   =    (x    [])    +    (y    []); 

g'    al   a2   =    if    ((al    []  )    =0)    then    (f    lambdaO  .  (a2    [] ) ) 

else    (f    lambdaO.S); 
h'    c  d  =  g'    lambdaO.CCc    [] )   +    (d    [])); 

Then,  the  definitions  of  reference  escape  semantic  values  /",  g",  and  h"  of  f  ',  g' ',  and 
h'  '  are  expressed  as  follows: 

/"     =.     ((0,0),Aa:.(x(i),A2/.((0,0),err))) 

g"     =     ((0,0),Aal.(al(i,,Aa2.(/('2)(a2(i),A().a2(2)((0,0),er7-))) 

h"     =     ((0,0),Ac.(c(i),Ad.5|2)((^(i)Urf(i)),A()-((0,0),err)))) 

Letenv^  =  [f  ^  f\f  '  ^  f'.g'  ^g\g"  -<7"-h'  ^h',h"  ^h"]. 

To  find  the  global  reference  escape  property  of  the  non-strict  function  h,  we  apply  the 
non-strict  global  reference  escape  test  function  G_Lrefescape?  as  follows: 

G_l_refescape?(h,  l,l,eni;,.)     =     {Rel^"    c   dleni'',)(i)(i) 

=     0 


where 


env'r  =  emv[cH.  ((1,  0),  A().((1,0),  H^('^'"')-^f*^'"'))), 
d^^  ((0,0),A().((0,0),H''(— "'^^(•-•""))1 


Similarly, 
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G-Lrefescape?(h,  2, 1,  enT;^)     =     {Rglh.' '    c  djeni;'r)(i)(i) 

=     0 

where 

env'r  =  envr[c^  ((0,  0),  A().((0,0),  H^(*^'"')^(*^'"'))), 

Thus,  we  can  conclude  that  neither  the  reference  associated  with  the  first  occurrence  of  the 
first  parameter  c  of  the  function  nor  the  reference  associated  with  the  first  occurrence  of 
the  second  parameter  d  of  the  function  h  escapes  h. 

7.3      Escapement  under  Evaluation  with  Strictness 

Strictness  information  about  parameters  of  a  lazy  function  can  be  used  for  improving  the 
lazy  evaluation  strategy  by  directly  evaluating  strict  arguments  before  they  are  passed 
to  the  function  body.  This  evaluation  strategy  can  be  considered  as  a  combination  of 
applicative-order  evaluation  (strict  semantics)  and  lazy  evaluation  (non-strict  semantics). 
The  escapement  property  under  this  evaluation  strategy  can  be  effected  by  transforming 
non-strict  programs  using  the  strictness  information  about  non-strict  functions.  We  assume 
that  with  individual  application  nodes  in  the  bodies  of  functions  strictness  information  is 
annotated  to  indicate  strict  applications  ([66]).  The  new  source-to-source  transformation 
function  M  of  type  Exp  -^  Powerset(/d)  — >  Exp  for  non-strict  programs  with  strictness 
aimotations  is  defined  in  Figure  7.4. 
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MlcjFId  =>     A().c 

Mix]  Fid  ^     ii{xe  Fid)  then  z  else  '{x  []  ) 

Mlei  +  ezjF/d     =>     {Mle,}  Fid)  +  {Mle 2}  Fid) 

I*  same  for  strict  operators  like  (cj  -  62)  and  (ci  =  62)  */ 
M|if  d  then  62  else  esj  F/d     =>     if  (MfeJ  F/d) 

then  (M[e2l  Fid) 
else  (Mfeal  ^'^'^) 
M|[eie2]  Fid  =>     if  d  €  {    car,    cdr   }  /*  strict  operator  */ 

then  (Midi  Fid)   (Mfezl  Fid) 
elseif  (strict. application'!)  /*  strict  application  */ 
then  (Midi  Fid)   (Mlej]  Fid) 
else  /*  non-strict  application  */ 
(Mjeil  Fid)  (A().MIe2l  Fid) 
M[lambda(a;).elF7d     =>     lambda(a;).(M|eI  F/d) 
Mfletrec  xi  =  ei;...x„  =  e„;inel  F/d     =;•     letrec 

ri=Mldl(F/du{xi,...,x„}); 

x„  =  M[e„I(F/du{j:„...,x„}); 

in 

Mleil(F/(iu{xi,...,x„}) 

Mplprj     =>     MlprjiD 

Figure  7.4:  Non-strict  Program  Transformation  with  Strictness  Information 
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Chapter  8 

Storage  Management 
Optimizations 


The  escape  information  that  is  inferred  at  compile-time  from  the  semantic  analyses  which 
have  been  described  in  preceding  chapters,  including  escape  analysis,  refined  escape  anal- 
ysis, reference  escape  analysis,  and  order-of-demand  analysis,  allows  a  variety  of  storage 
management  optimizations  in  functional  language  implementations. 

In  this  chapter,  we  propose  a  variety  of  optimization  techniques,  based  on  statically 
inferred  escape  information,  to  reduce  the  storage  management  overhead  in  functional  lan- 
guage implementation,  including  stack  allocation,  explicit  reclamation,  in-place  reuse  of 
garbage  cells,  reference  counting  elimination,  block  allocation/reclamation,  and  improving 
generational  garbage  collection. 

8.1      Stack  Allocation 

The  need  for  heap  allocation  of  objects,  such  as  arguments  and  locally  defined  objects 
within  a  higher-order  function,  arises  because  they  may  outlive  a  call  to  that  function, 
th.:t  is,  the  environment  in  which  they  were  created.  Thus,  they  cannot  be  deallocated 
when  the  environment  is  left  and  its  bindings  are  deallocated.  For  example,  when  a  partial 
application  or  explicit  lambda  expression  is  evaluated  to  produce  a  closure,  the  storage  must 
be  allocated  and  the  values  must  be  moved  into  the  closure.  Generally,  closures  (the  code 
pointer  and  environment)  need  to  be  stored  in  the  heap  at  run-time  and  reclaimed  by  some 
garbage  collection  process. 

On  most  current  svstems,  the  stack  allocation  and  deallocation  is  usuallv  more  efficient 


165 


both  in  space  and  in  time  than  the  heap  allocation  and  garbage-collected  reclamation,  al- 
though the  overhead  of  a  garbage  collection  can  be  quite  small  with  a  sufficiently  large 
amount  of  physical  memory  and  a  sophisticated  garbage  collection  strategy  [5].  The  moti- 
vation is  to  avoid  allocation  of  objects  in  the  heap  and  instead  to  allocate  them  in  the  stack. 
Objects  that  would  otherwise  be  allocated  in  the  heap  and  then  reclaimed  using  garbage 
collection  are  allocated  in  stack-like  storage  and  cheaply  reclaimed  without  invoking  garbage 
collection.  Optimizations  that  convert  heap  allocations  into  stack-like  storage  allocations 
are  expected  to  save  significant  time.  Converting  heap  allocation  to  stack  allocation  may 
also  permit  further  optimizations. 

Escape  information  about  parameters  of  a  strict  function  that  is  inferred  through  the 
(refined)  escape  analysis  can  be  used  for  the  stack  allocation  optimization.  Consider  any 
expression  of  the  form  of 

(/ei   ...  e,  ...  Cn) 

where  /  is  a  function  with  n  parameters,  and  each  e^,  1  <  z  <  n,  is  any  possible  expression. 
Let  e,  be  an  expression  whose  evaluation  requires  to  storage  allocation.  The  storage  for  the 
value  of  Ci  generally  needs  to  be  allocated  from  a  heap,  because  the  lifetime  of  e,  carmot  be 
predicted.  Based  on  the  global  escape  information  about  the  parameters  of  /,  more  efficient 
storage  allocation  can  safely  be  done  for  e,  as  follows: 

•  If  the  i'^  parameter  of  /  does  not  escape  /  globally  then  allocate  the  storage  for  e  in 
the  stack  where  the  activation  record  for  /  resides,  else  allocate  the  storage  for  e  in 
the  heap. 

•  If  the  value  of  e,  is  a  constant  list  and  the  top  j  spines  of  the  t"*  parameter  of  /  does 
not  escape  /  globally  then  allocate  the  storage  for  cells  at  the  top  _;  spines  in  the 
stack  where  the  activation  record  for  /  resides,  and  allocate  the  storage  for  cells  at 
the  remaining  spines  in  the  heap. 

Consider  a  particular  subexpression  of 

(/  ei   ...  e,   ...  e„) 

where  /  is  a  function  with  n  parameters.  Similarly,  the  local  escape  information  of  param- 
eters of  /  in  (/  C)  . . .  e,  . . .  e„)  can  be  used  for  more  efficient  storage  allocation  for  e,  as 
follows: 
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•  If  the  I     parameter  of  /  does  no<  escape  /  in  the  particular  application  (/ ei   ...  e,  ...  e^) 
then  allocate  the  storage  for  e,  in  the  stack  where  the  activation  record  for  /  resides, 
else  allocate  the  storage  for  e^  in  the  heap. 

•  K  the  value  of  e,  is  a  constant  list  and  the  top  j  spines  of  the  f"*  parameter  of  /  does 
not  escape  /  in  (/  cj  ...  e,  ...  e„)  then  allocate  the  storage  for  cells  at  the  top  j 
spines  in  the  stack  where  the  activation  record  for  /  resides,  and  allocate  the  storage 
for  cells  at  the  remaining  spines  in  the  heap. 

As  an  example,  consider  the  program  given  in  Chapter  2  as  follows: 

letrec  g  a  b  =  if  (a  <  b)  then  0  else  a; 

h  c  d  =  if  (c  <  d)  then  d  else  0; 

map  f  1  =  if  (null  1)  then  nil 

else  cons  (f  (car  1))  (map  f  (cdr  1)); 

in   ...  (map  (g  3)  [1.3.5])  ...  (map  (h  3)  [1.3.5])  ... 

From  the  global  escape  analysis,  we  know  that  the  first  parameter  f  of  the  function  map  can 
never  escape  map  globally.  Thus,  in  any  subexpression  of  (map  ei  €2)  where  the  evaluation 
of  ei  requires  storage  allocation,  that  storage  for  ei  can  safely  be  allocated  in  the  stack  in 
which  the  activation  record  for  map  resides.  So,  the  storage  for  the  closures  representing  (g 
3)  and  (h  3)  can  be  allocated  in  the  stack  instead  of  the  heap. 

Even  though  we  cannot  conclude  from  the  global  escape  analysis  that  the  second  pa- 
rameter 1  of  the  function  map  does  not  escape  map  globally,  the  local  escape  analysis  tells  us 
that  the  second  parameter  1  of  the  function  map  does  not  escape  map  locally  in  (map  (g  3) 
[1.3,5]),  while  the  second  parameter  1  of  the  function  map  does  escape  map  locaDy  in  (map 
(h  3)  [1,3.5]).  Thus,  the  storage  for  the  cons  cells  of  [1 .3,5]  in  (map  (g  3)  [1,3,5]) 
can  also  be  allocated  in  the  stack  instead  of  allocating  in  the  heap. 

The  global  refined  escape  analysis  tells  us  more  refined  escape  information  about  the 
second  parameter  1  of  map,  i.e.  the  top  spine  of  1  does  not  escape  map  globally.  Thus,  the 
storage  for  the  cons  cells  of  [1,3.5]  in  (map  (h  3)  [1,3,5])  can  also  be  allocated  in  the 
stack  instead  of  the  heap. 

Escape  information  about  the  parameters  of  a  non-strict  (lazy)  function  that  is  inferred 
through  the  escape  analysis  can  be  used  for  the  stack  allocation  optimization.  Consider  any 
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expression  of  the  form  of 

(/ei  ...  ei  ...  e„) 

where  /  is  a  lazy  function  with  n  parameters,  and  each  e,,  1  <  t  <  n,  is  any  possible 
expression.  Each  argument  e,  to  /  requires  storage  allocation  for  representing  its  delayed 
evaluation  such  as  a  thunk  in  the  normal-order  evaluation  model  or  a  self -modifying  thunk 
in  the  lazy  evaluation  model.  Generally,  the  storage  for  each  e,  needs  to  be  allocated  in 
a  heap.  Based  on  the  global  escape  information  about  the  parameters  of  /,  more  efficient 
storage  allocation  can  safely  be  performed  for  the  thunk  of  each  e^  as  follows: 

•  If  the  i'  parameter  of  /  does  not  escape  /  globally  then  allocate  the  storage  for  the 
thimk  of  e,  in  the  stack  where  the  activation  record  for  /  resides,  else  allocate  the 
storage  for  the  thunk  of  e,  in  the  heap. 

Similarly,  the  /oca/ escape  information  about  the  parameters  of/  in  (/  ej  ...  e,  ...  Cn) 
can  be  used  for  more  efficient  storage  allocation  for  the  thunk  of  each  e,  as  follows: 

•  If  the  i""  parameter  of  /  does  not  escape  /  in  (/  C]  ...  e,  ...  e„)  then  allocate  the 
storage  for  the  thunk  of  c,  in  the  stack  where  the  activation  record  for  /  resides,  else 
allocate  the  storage  for  the  thunk  of  e,  in  the  heap. 

As  an  example,  consider  the  following  lazy  program  from  Chapter  7: 

letrec   f  x  y  =  x+y; 

g  a  =  if  (a=0)  then  (f  a)  else  (f  3); 

h  c  d  =  g  (c+d) ; 
in   ...   h  (f  1  2)  (f  3  4)  .  .  . 

From  the  global  escape  analysis,  we  know  that  neither  the  first  parameter  c  nor  the  second 
parameter  d  of  the  function  h  escapes  h.  Thus,  in  any  subexpression  of  (h  C]  62),  the  storage 
for  the  thanks  for  Ci  and  €2  can  safely  be  allocated  in  the  stack  where  the  activation  record 
map  resides.  So,  the  self-modifying  thunks  for  both  (f  1  2)  and  (f  3  4)  in  h  (f  1  2)  (f 
3   4)  could  be  allocated  in  the  stack  where  the  activation  record  for  h  resides. 

Safety  Issue 

From  a  practical  point  of  view,  however,  there  are  safety  issues  in  the  application  of  storage 
allocation  optimization,  i.e.  unrestricted  apphcation  of  the  stack  allocation  optimization 
may  he  unsafe  in  the  sense  that  it  can  convert  programs  that  run  well  into  programs  that 

168 


fail  (due  to  stack  overflow).  The  safety  condition  is  that  the  stack  allocation  optimization 
should  not  convert  a  program  that  runs  robustly  into  one  that  does  not  ([20],  [21]). 

8.2      Explicit  Reclamation 

When  heap-allocated  objects  are  no  longer  needed,  they  can  often  be  reclaim.ed  into  a  free 
storage  list  explicitly  by  the  program  without  invoking  the  garbage  collection.  This  is  done 
by  identifying  at  compile  time  where  run-time  storage  management  decisions  can  be  made, 
i.e.  the  places  in  a  program  where  storage  can  safely  be  collected.  When  we  can  predict  at 
compile  time  when  cells  will  become  garbage,  we  can  embed  into  the  executable  progrcim 
additional  operations  which  immediately  link  the  garbage  cells  to  the  available  free  list. 
Thus,  we  can  avoid  some  of  the  expensive  operations  usually  used  to  detect  garbage  at  run 
time. 

Detecting  Sharing  using  Escape  Information 

Sharing  information  about  cells  can  be  determined  using  the  escape  information. 

Theorem  8.1  (Sharing  Information)  Let  f  be  a  function  which  takes  n  arguments  such 
that  d,  IS  the  number  of  spines  of  the  z"*  parameter  of  f  for  i  =  1  . .  .n,  and  let  f  return  a 
list  with  dj  spines.  If  esci  be  the  number  of  escaping  spines  of  the  i^^  parameter  of  f  for 
i  =  1  . .  .71  (statically  inferred  by  escape  analysis),  then 

1.  all  cells  in  the  top  (dj  -  max{min{esc\,  (d-^  —  Uj)}, . .  .,77im{e5c„,  {dr,  —  Un)}})  spines 
of  the  result  of  [f  e\  . . .  e^)  are  unshared  for  arguments  Ci, . .  .  .e^  such  that  u,  is  the 
number  of  unshared  spines  of  Ci . 

2.  all  cells  in  the  top  (dj  -  max{esci, . . .,  e5c„}j  spines  of  the  result  of  (/  ei  . .  .e„),  for 
any  set  of  arguments  Cj, . .  ..e„,  are  unshared. 

Proof  :       1.    The  number  of  spines  of  e,  that  are  shared  is  (d,  -  u,).    The  number  of 

shared  spines  of  e,  that  could  escape  /  is  mznje^c,,  (d,  —  u,)}.  In  the  result  of  (/ci  ...€„), 

the  bottom  max{min{esc,,{dt  —  u,)}}  spines  will  be  shared.    Thus,  all  cells  in  the  top 

(df  -  max{min{esci,{di  -  Ui)}, . .  .  ,min{esCm{d„  -  u„)}})  spines  of  the  result  are  not 

shared. 

2.   Since  we  consider  any  set  of  arguments  £],....€„,  and  we  have  no  sharing  information 

of  e,,  we  assume  that  u,  =  0  as  the  worst-case.   Then.  min{cscj,{d,  —  0)}  =  esci  because 
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esci  <  di.  Thus,  all  cells  at  top  {dj  -  max{min{esci, . . . ,  escn}})  spines  of  the  resiilt  are 
not  shared.  □ 

As  an  example,  consider  the  program  given  in  Chapter  3  as  follows: 

letrec  ps  x  =  if  (null  x)  then  nil 

else  letrec  y  =  split  (car  x)  (cdr  x)  nil  nil; 
in  append  (ps  (car  y)) 

(cons  (car  x)  (ps  (car  (cdr  y)))); 

split  p  X  1  h  =  if  (null  x)  then  (cons  1  (cons  h  nil)) 
elseif  (car  x)<p  then 

split  p  (cdr  x)  (cons  (car  x)  1)  h 

else  split  p  (cdr  x)  1  (cons  (car  x)  h)  ; 

append  x  y  =  if  (null  x)  then  y 

else  cons  (car  x)  (append  (cdr  x)  y) ; 
in  ps  [5.2,7,1,3,4] 

The  function  ps  takes  a  list  with  one  spine  as  its  argument,  and  returns  a  list  with  one  spine. 
From  the  global  refined  escape  analysis,  we  know  that  no  spine  of  the  argument  escapes 
ps  globally.  Thus,  for  any  expression  (ps  e)  where  e  is  a  list  with  one  spine,  we  conclude 
that  the  top  spine  of  the  result  list  of  (ps  e)  is  not  shared.  The  function  s'plit  takes  four 
arguments  p,  x,  1  and  h  whose  type  are  int,  int  list,  int  list  and  int  list,  respectively, 
and  returns  a  list  with  two  spines.  From  the  global  refined  escape  analysis,  we  know  that 
none  of  the  first  parameter  p,  all  but  the  top  spine  of  the  second  parameter  x,  and  a\\  of 
the  third  and  fourth  parameters  1  and  h  escape  split  globally.  Thus,  we  conclude  that, 
for  any  subexpression  of  (split  Ci  €2  63  64)  where  each  e,  is  any  possible  expression,  the 
top  spine  of  the  result  list  of  (split  ej  63  63  €4)  is  not  shared. 

We  can  detect  some  garbage  objects  at  compile-time  using  sharing  cind  escape  informa- 
tion. 

Theorein  8.2  Consider  an  expression  (/  Cj, . . . ,  e,, . . . ,  e„),  where  f  is  a  function  of  arxty 
n.   Then, 

1.  If  e,  is  a  function  type  and  the  f  parameter  of  f  does  not  escape  f,  then  the  storage 
for  representing  the  closure  of  e,  is  garbage  after  the  execution  of  the  expression,  and 
thus  can  safely  be  reclaimed  after  the  execution  of  the  expression. 
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2.  Ifci  is  a  list  with  top  u,  unshared  spines  and  the  bottom  esci  spines  of  the  i^  parameter 
with  di  spines  escape  f,  then  all  cells  at  the  top  77zm{w,,  (d,  —  e5c,)}  spines  of  e^  are 
garbage  after  the  execution  of  the  expression,  and  thus  can  safely  be  reclaimed  after 
the  execution  of  the  expression. 

Proof  :  Since  the  number  of  unshared  spines  of  e,  is  Ui,  all  cells  in  the  top  Ui  spines  of  e^ 
are  unshared  before  the  execution  of  /.  Since  the  bottom  esci  spines  of  e,  escape  /,  the  top 
{d,  —  esci)  spines  of  ei  do  not  escape  /.  The  spines  of  e^  that  do  not  escape  /  and  are  not 
shared  will  be  inaccessible  at  the  end  of  execution  of  /.  Thus,  the  top  Tnin{u,,  (d,  -  esc,)} 
spines  of  e,  become  garbage  during  the  execution  of  the  body  of  /  and  are  garbage  after 
the  execution  of  /.  □ 

Escape  information  that  is  inferred  from  the  (refined)  escape  analysis  can  be  used  for 
the  exphcit  reclamation  optimization.  Consider  any  subexpression  of  the  form  of 

if  ei  ...e,_i  {g  e[  ...e'^)  e.+i  ...€„) 

where  /  and  g  are  fimctions  with  arity  n  and  m,  respectively.  Let  the  result  of  {g  e[  . .  .e'^) 
be  a  heap-allocated  object.  GeneraDy,  that  object  is  reclaimed  by  garbage  collection.  Using 
the  global  escape  information  about  the  parameters  of  /,  more  efficient  storage  reclamation 
can  safely  be  done  for  the  result  of  [g  e\  . .  .e^)  as  follows: 

•  When  the  z'""  parameter  of  /  is  a  function  type  :  If  the  i  parameter  of  /  does  not 
escape  /  globally  then  the  subexpression  can  safely  be  transformed  into 

RECLAIM.!/  ei  . .  .e,_i  {g  c[  ...e'^)  e,+i  . .  .e„) 

where  RECLAIM,  reclaims  the  z'""  argument  of  /. 

•  When  the  z"'  jiarameter  of  /  is  a  list  type  with  d,  spines  :  If  the  bottom  esc,  spines 
of  the  z""  parameter  of  /  escapes  /  then  the  subexpression  can  safely  be  transformed 
into 

RECLAIM^/  e,  . .  .e,_,  (g  e\...e'^)  e,+,  . .  .e„) 

where 

s  =  niin{{d,  -  max{esc\, .  .  .,esc[^}),{d,  -  esc,)}, 

csc[,  1  <  2  <  m,  is  the  number  of  bottom  spines  of  the  z'''  parameter  off?  that  escape 
y.  and  RECLAIM'  reclaims  all  cells  in  the  the  top  s  spines  of  the  z""  argument  of  /. 
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As  an  example,  consider  the  same  program  as  in  section  8.1.  From  the  global  refined  escape 
analysis,  we  know  that  append  returns  all  of  its  second  argument  y,  and  all  but  the  top 
spine  of  the  first  argument  x.  We  also  know  that,  for  any  expression  (ps  e)  where  e  is  a  list 
with  one  spine,  the  top  spine  of  the  result  of  (ps  e)  is  unshared.  Thus,  the  definition  of  ps 
can  be  transformed  into  PS  as  follows: 

PS   x   =    if    (null   x)    then  nil 

else   letrec   y   =    split    (car   x)    (cdr   x)    nil   nil; 
in   RECLAIM<1,1>   append    (PS    (car  y)) 
(cons    (car   x)    (PS    (car    (cdr   y)))); 

where  RECLAIM<1,1>  reclaims  all  cells  in  the  top  spine  of  the  first  argument  of  append. 
Note  that,  from  the  global  escape  analysis,  we  know  that  the  top  spine  of  ps's  parameter 
does  not  escape  from  ps,  only  some  elements  do.  So,  each  cell  of  the  top  spine  of  the  list 
ps    [5,2,7,1,3,4]  could  be  allocated  in  the  activation  record  for  ps. 

8.3      In-place  Reuse 

When  heap-allocated  objects  are  no  longer  needed  and  other  objects  need  to  be  allocated, 
the  storage  can  be  reused  directly  by  the  program  without  new  allocation  and  without 
invoking  garbage  collection.  The  motivation  is  to  replace  the  allocation  of  new  cells  by 
direct  reuse  of  previously  deallocated  garbage  cells. 

Theorem  8.3  Consider  an  expression  (f  Ci, ...,  e^, ..  .,€„),  where  f  is  a  function  with 
n  parameters.  Then,  if  each  Ci  is  a  list  with  its  top  u,-  spines  unshared,  and  the  bottom 
esc,  spines  of  the  d,  spines  of  the  i  parameter  of  f  escape  f  then  all  cells  in  the  top 
min{u,,  (d,  -  esc,)}  spines  of  e,  are  garbage  after  the  execution  of  the  expression,  and  thus 
can  safely  be  reused  during  the  execution  of  the  expression. 

Proof  :  Since  the  number  of  unshared  spines  of  e,  is  u,,  all  cells  at  top  u,  spines  of 
e,  are  unshared  before  the  execution  of  /.  Since  the  bottom  esc,  spines  of  e;  escape  /, 
the  top  {d,  -  esc,)  spines  of  e,  do  not  escape  /.  The  spines  of  e,  that  do  not  escape  / 
and  are  not  shared  will  be  inaccessible  at  the  end  of  the  execution  of  /.  Thus,  the  top 
Tnin{u,,  (d,  -  esc,)}  spines  of  e,  become  garbage  during  the  execution  of  the  body  of  /  and 
are  garbage  after  the  execution  of  /.  D 

Escape  information  about  parameters  of  a  strict  function  that  is  inferred  by  the  (refined) 
escape  analysis  can  be  used  for  the  in-place  reuse  optimization.  Consider  an  expression  of 
the  form  of 

172 


if  ei  ...  Ci  ...e„) 

where  /  is  a  function  with  n  parameters,  the  i"*  parameter  of  /  is  a  list  type  with  d,  spines, 
and  there  occurs  some  cons  in  the  body  of  /.  Let  all  cons  cells  at  the  top  u,  spines  of  the 
result  of  e,-  be  unshared.  Generally,  each  cons  appearing  in  the  body  of  /  allocates  a  new 
cons  cell  in  the  heap,  and  such  cons  cells  are  reclaimed  by  garbage  collection.  Using  the  global 
escape  information  of  parameters  of  /,  more  efficient  storage  allocation  and  reclamation  can 
safely  be  performed  as  follows: 

•  If  the  bottom  esci  spines  of  the  z"*  parameter  of  /  escapes  /  globally  then  the  subex- 
pression can  safely  be  transformed  into 

(//  ei  ...  ei  ...Cn) 

where 

5  =  min^Ui,  [di  —  esci)}, 

and  f'  is  a  new  version  of  /  which  directly  reuses  cells  in  the  top  s  spines  of  the  z"' 
argument  of  /  for  new  cells  needed  in  the  body  of  /. 

Consider  a  function  /  as  follows: 

/  zi   ...  a;„    =     ...  (cons  Ci  62)  ... 

•  If  there  is  no  use  of  the  i'-^  parameter  x^  of  /  after  the  evaluation  of  the  subexpression 
(cons  £]  62)  then  a  new  version  //  of  /  which  uses  the  in-place  reuse  optimization 
can  be  defined  as  follows: 

//  a-i    ...!•„    =     ...  (DCONS  a;,  ei  e,)   ... 

where  DCONS  is  a  destructive  version  of  cons  defined  by 

DCONS  ab  c     =     {p  :=  a; 

car(a)  :=  b; 
cdr(a)  :=  c; 
return[p)}. 

As  an  example,  consider  the  partition  sort  program  from  the  previous  section.  From  the 
global  refined  escape  analysis,  we  know  that  append  returns  all  of  its  second  argument  y, 
and  all  but  the  top  spine  of  the  first  argument  x.  The  top  spine  of  the  list  that  ps  returns  is 


173 


iinshared.  We  also  know  that,  for  any  expression  (ps  e)  where  e  is  a  list  with  one  spine,  the 
top  spine  of  the  result  of  (ps  e)  is  unshared.  Thus,  the  definition  of  ps  can  be  transformed 
into  PS  as  follows: 

PS  X  =  if  (null  x)  then  nil 

else  letrec  y  =  split  (car  x)  (cdr  x)  nil  nil; 
in  APPEND  (PS  (car  y)) 

(cons  (car  x)  (PS  (car  (cdr  y)))); 

where  APPEND  is  a  version  of  append  in  which  cells  are  directly  reused.  It  is  defined  by 


APPEND   X   y   =    if    (null   x)    then  y 

else   DCONS   x    (car  x)    (APPEND    (cdr   x)    y) ; 

Furthermore,  if  we  know  that  the  top  spine  of  the  cirgument  of  ps  is  unshared,  then  the 
definition  of  ps  can  be  transformed  into  PS'  as  follows: 

PS'  X  =  if  (null  x)  then  nil 

else  letrec  y  =  split  (car  x)  (cdr  x)  nil  nil; 
in  APPEND  (PS'  (car  y)) 

(DCONS  X  (car  x)  (PS'  (car  (cdr  y)))); 

8.4      Reference  Counting  Elimination 

Reference  counting  is  a  storage  reclamation  method  in  which  each  object  contains  a  count, 
called  the  reference  count,  of  the  number  of  references  (pointers)  pointing  to  it.  When  an 
object  is  first  allocated,  its  reference  count  is  set  to  one.  The  reference  count  is  updated 
during  execution  as  follows:  Each  time  a  new  reference  to  an  object  is  created,  the  object's 
reference  count  is  incremented  by  one.  Each  time  a  reference  to  an  object  is  destroyed, 
the  object's  reference  count  is  decremented  by  one.  When  an  object's  reference  count 
becomes  zero,  it  can  be  reclaimed  and  the  reference  count  of  each  object  that  it  points 
to  is  decremented.  Though  the  reference  counting  strategy  has  disadvantages,  such  as 
storage  fragmentation  and  the  inability  to  reclaim  cyclic  structures,  its  major  advantage  is 
that  storage  reclamation  occurs  incremently  throughout  program  execution;  storage  can  be 
reclaimed  as  soon  as  it  has  become  garbage.  It  is  also  especially  suitable  in  multiprocessor 
architectures  with  distributed  memory,  since  reference  counting  is  an  inherently  real-time 
and  localized  activity. 
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The  major  overheads  that  are  incurred  in  reference  counting  schemes  are  as  follows: 

•  Space  overhead  for  maintaining  a  reference  count  in  each  object. 

•  Time  and  code  overhead  for  updating  reference  cotuits  when  references  are  created  or 
destroyed. 

•  Communication  overhead  for  manipulating  a  remote  reference  and  for  synchronizing 
the  operations  on  reference  counts  in  distributed  memory  enviroimients  ([57]). 

We  describe  a  method  for  reducing  the  time,  code,  and  communication  overhead  of  reference 
counting  in  both  uniprocessor  and  multiprocessor  environments  by  compile-time  program 
analysis.  Our  approach  is  based  on  the  observation  that  such  overheads  can  be  reduced  by 
avoiding  uimecessary  reference  count  updates  using  statically  inferred  information  about 
the  lifetime  of  each  reference.  The  lifetime  of  a  reference  to  an  object  is  the  period  from 
when  the  reference  is  created  until  its  last  use.  Suppose  0  is  an  object  that  is  active  at 
some  time  to  during  execution.  Since  this  object  is  active,  there  is  at  least  one  reference 
pointing  to  it.  If  its  reference  count  O^c  is  n  then  there  are  exactly  n  references  pointing  to 
it.  Suppose  A  is  one  of  those  references.  Now,  suppose  that  a  new  reference  B  to  the  object 
is  created.  The  current  reference  count  of  the  object  is  incremented,  i.e.  Ore  '■=  Ore  +  ^• 
At  some  later  time  ti ,  suppose  that  B  is  discarded.  Then,  the  current  reference  count  of 
the  object  is  decremented,  i.e.   Ore  '■=  Ore  -  1- 

If  we  can  determine,  at  compile-time,  that  A  will  still  be  active  at  time  i; ,  then  no 
reference  count  operations  are  required  when  B  is  created  or  destroyed.  Since  the  reference 
count  of  0  always  remains  greater  than  or  equal  to  one  from  time  tg  to  time  t^ ,  O  will  not 
to  be  reclaimed  between  time  to  and  time  t, .  Thus,  the  reference  count  updating  operation 
for  the  reference  B  can  be  avoided.  This  avoidance  optimization  is  safe  because  any  object 
which  is  still  active  will  not  be  reclaimed. 

Reference  escape  information  that  is  inferred  from  the  reference  escape  analysis  can  be 
used  for  the  reference  counting  elimination  optimization.  Let  /  be  a  strict  or  lazy  function 
defined  as  follows: 

f  Xi     ...    Xr,     =      ...    2;,j     ... 

where  !•,_,  is  the  j""  occurrence  of  the  z"'  parameter  z,  in  the  body  of  /  such  that  it  causes 
the  creation  of  a  reference  to  the  i'^  argument  of  /  during  the  evaluation  of  an  application 
of  /  to  n  arguments.  In  classic  reference  counting  scheme,  the  reference  count  of  the  z"* 
argument  of  /  needs  to  be  u])dated  when  the  reference  associated  with  x,j  is  created  and 
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destroyed.  Based  on  the  gZo6a/ reference  escape  information  of  occurrences  of  the  parameters 
of  /,  more  efficient  reference  coimt  updating  can  safely  be  done  as  follows: 

•  If  Xij  does  not  reference-escape  /  globally  then  just  create  and  destroy  the  reference 
without  reference  coimt  updates  else  create  and  destroy  the  reference  with  reference 
count  updates 

Furthermore,  given  two  references  A  and  5  to  a  heap  allocated  object,  the  relative 
lifetimes  of  A  and  B  can  be  computed  by  determining  if  there  is  a  scope  from  which  one 
of  them  escapes  but  not  the  other.  K  so,  when  the  shorter-lived  reference  is  created  and 
destroyed,  no  reference  count  operations  are  necessary.  In  some  programs,  in  fact,  our 
analysis  can  determine  if  some  reference  R  to  an  object  outlives  all  others.  Thus,  the  object 
can  be  reclaimed  as  soon  as  R  is  destroyed.  No  other  reference  counting  operations  are 
needed.  Notice,  however,  that  it  may  not  be  possible  to  determine  lifetime  of  R  (if  it  is 
embedded  in  a  structure,  for  instance),  and  thus  of  the  object,  at  compile  time. 

As  an  example,  consider  the  program  given  in  Chapter  4: 

letrec  map  f  1  =  if  (null  1)  then  nil 

else  cons  (f  (car  1))  (map  f  (cdr  1)); 

sum  1  =  if  (null  1)  then  0 

else  (car  1)  +  sum  (cdr  1) ; 

addsum  x  y  =  cons  x  (cons  y  (cons 

(map  (lambda(z) .  (sum  Y)  +  z)  X)  nil)); 
in  .  .  . 

From  the  reference  escape  analysis,  we  know  that  the  reference  associated  with  the  second 
occurrence  of  each  parameter  x  and  y  of  addsum  does  not  escape.  Thus,  updates  on  the 
reference  count  of  each  parameter  could  be  avoided  when  creating  and  deleting  the  reference. 
Consider  the  following  lazy  program  from  Chapter  7: 

letrec  f  x  y  =  x+y; 

g  a  =  if  (a=0)  then  (f  a)  else  (f  3); 

h  c  d  =  g  (c+d); 
in   ... 

From  the  reference  escape  analysis,  we  know  that  neither  the  reference  associated  with  the 
first  occurrence  of  the  first  parameter  c  of  the  function  nor  the  reference  associated  with 
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the  first  occurrence  of  the  second  parameter  d  of  the  function  h  escapes  h.  Thus,  reference 
count  updatings  can  be  avoided  when  these  references  are  created  and  deleted. 

8.5      Block  Allocation/Reclamation 

In  this  scheme,  a  number  of  objects  are  allocated  together  in  a  contiguous  block  of  a  heap 
storage  and  the  whole  block  is  put  on  the  free  list,  rather  than  the  individual  objects.  This 
allows  reclamation  of  larger  segments  of  storage,  and  reduces  run-time  overhead  by  avoiding 
the  traversal  of  the  individual  objects  (in  mark-sweep  collection,  for  instance). 

Escape  information  about  the  parameters  of  a  strict  function  that  is  inferred  at  compile- 
time  through  the  (refined)  escape  analysis  can  be  used  for  the  block  cillocation/reclamation 
optimization.  Consider  any  subexpression  of  the  form  of 

(/  ei  ...  e,  ...  e„) 

where  /  is  a  function  with  n  parameters,  and  each  e,,  1  <  f  <  n,  is  any  possible  expression. 
Let  Cj  be  an  expression  whose  evaluation  requires  the  allocation  of  a  number  of  storage 
cells.  Generally,  each  individual  cell  of  the  value  of  e,  needs  to  be  allocated  in  a  different 
area  from  a  heap.  Based  on  the  global  escape  information  of  pcircimeters  of  /,  more  efficient 
storage  allocation  can  safely  be  performed  for  e,  as  follows: 

•  If  the  top  _;■  spines  of  the  i"'  parameter  of  /  does  not  escape  /  globally  then  allocate 
all  cells  in  the  top  j  spines  together  in  the  same  block  in  the  heap 

Consider  a  particular  expression 

(/ei   ...  Ci  ...  e„) 

where  /  is  a  function  with  n  pcirameters.  Similarly,  the  local  escape  information  about  the 
parameters  of  /  in  (/  ei  ...  e,  ...  e^)  can  be  used  for  more  efficient  storage  allocation  for 
e,  as  follows: 

•  If  the  top  j  spines  of  the  i""  parameter  of  /  does  not  escape  /  in  (/  C]    ...  e,  ...  €„) 
then  allocate  all  cells  at  the  top  j  spines  together  in  the  sanie  block  in  the  heap 

As  an  example,  consider  the  program  in  section  8.1.  From  the  escape  analysis,  we  know  that 
the  top  spine  of  ps's  parameter  does  not  escape  from  ps,  only  some  elements  do.  Thus,  each 
cells  of  the  top  spine  of  the  list  ps  [5  ,2,7  , 1 ,3  ,4]  could  be  allocated  in  the  same  block  in 
the  heap. 
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8.6      Improving  Generational  Garbage  Collection 

Generational  garbage  collection  groups  objects  into  areas  according  to  their  predicted  life- 
times, and  collect  areas  independently  and  asynchronously. 

Escape  information  about  parameters  of  a  strict  function  that  is  inferred  at  compile-time 
through  the  (refined)  escape  analysis  can  be  used  for  improving  the  generational  garbage 
collection  schemes.  Consider  any  expression  of  the  form  of 

(/ei   ...  e,  ...  e„) 

where  /  is  a  function  with  n  parameters,  and  each  e,,  1  <  i  <  n,  is  any  possible  expression. 
Let  e,  be  an  expression  whose  evaluation  requires  storage  for  the  result.  In  classic  gener- 
ational garbage  collection,  the  storage  for  the  value  of  e,  needs  to  be  allocated  in  a  new 
area  (the  youngest  generation)  in  a  heap.  Based  on  the  global  escape  information  about 
the  parameters  of  /,  more  efficient  selection  of  generations  can  safely  be  performed  for  e, 
as  follows: 

•  If  the  f  parameter  of  /  does  not  escape  /  globally  then  allocate  the  storage  for  e^ 
in  a  region  with  current  youngest  generation  else  allocate  the  storage  for  €{  in  some 
region  with  older  generations. 

•  If  the  value  of  e,  is  a  list  and  the  top  j  spines  of  the  z""  parameter  of  /  does  not  escape 
/  globally  then  allocate  the  storage  for  cells  at  the  top  j  spines  in  a  region  with  the 
youngest  generation  and  allocate  the  storage  for  cells  in  the  remaining  spines  in  some 
region  with  older  generations. 

Consider  a  particular  expression 

(/ei    ...  e,   .  ..  e„) 

where  /  is  a  function  with  n  parameters.  The  /oca/ escape  information  about  the  parameters 
of  /  in  (/  ei   ...  e,  ...  e„)  can  be  used  for  more  efficient  storage  allocation  for  e,  as  follows: 

•  If  the  i'^  parameter  of  /  does  not  escape  /  in  (/  ei  ...  e,  ...  e„)  then  allocate  the 
storage  for  e,  in  a  region  with  the  youngest  generation  else  allocate  the  storage  for  e,- 
in  some  region  with  older  generations. 

•  If  the  value  of  e,  is  a  constant  fist  and  the  top  j  spines  of  the  z""  parameter  of  /  does 
not  escape  /  in  (/  ei  ...  e,  ...  e^)  then  allocate  the  storage  for  cells  at  the  top  j 
spines  in  a  region  with  the  youngest  generation  and  allocate  the  storage  for  cells  in 
the  remaining  spines  in  some  region  with  older  generations. 


Escape  information  about  the  parameters  of  a  non-strict  fimction  that  is  inferred  at 
compile-time  through  the  escape  analysis  can  be  used  for  improving  the  generational  garbage 
collection  scheme.  Consider  any  expression  of  the  form 

(/  ej  ...  ei  ...  en) 

where  /  is  a  lazy  function  with  n  parameters,  and  e^,  1  <  i  <  n,  is  any  possible  expres- 
sion. Each  argument  €{  to  /  requires  the  allocation  of  storage  for  representing  its  delayed 
evaluation,  such  as  a  thunlc  in  the  normal-order  evaluation  model  or  a  self-modifying  thunk 
in  the  lazy  evaluation  model.  Generally,  the  storage  for  each  e^  needs  to  be  allocated  from 
a  heap.  Based  on  the  global  escape  information  about  the  parameters  of  /,  more  efficient 
selection  of  the  generations  of  storage  for  Ci  can  be  done  as  follows: 

•  If  the  i  parameter  of  /  does  not  escape  /  globally  then  allocate  the  storage  for  the 
thuitk  for  €{  in  a  region  with  the  current  youngest  generation  else  allocate  in  some 
region  with  older  generations. 

Similarly,  the  /oca/ escape  information  about  the  parameters  of  /  in  (/  ei  ...  e,  ...  e^)  can 
be  used  for  more  efficient  storage  allocation  for  the  thunk  for  each  e,  in  (/  ei  ...  e,  ...  e„) 
as  follows: 

•  If  the  f  parameter  of  /  does  not  escape  /  locally  in  (/  ej  ...  e;  ...  e„)  then 
allocate  the  storage  for  thunk  of  e^  in  a  region  with  the  current  youngest  generation 
else  allocate  in  some  region  with  older  generations. 
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Chapter  9 

Related  Work,  Conclusions,  and 
Future  Work 


In  this  chapter,  we  survey  some  previous  work  related  this  thesis,  summarize  the  contribu- 
tions of  this  thesis,  and  suggest  some  further  research  in  tliis  area. 

9.1      Related  Work 

Escape  and  Lifetime  Information 

Brooks,  Gabriel,  and  Steele  [16]  described  a  simple  first-order  escape  analysis  for  numbers 
in  LISP,  but  did  not  extend  it  for  arbitrary  objects.  Orbit,  an  optimizing  compiler  for 
Scheme,  used  a  simple  first-order  escape  analysis  to  stack  allocate  closures  [42].  Hudak  and 
Kranz  [42]  used  a  simple  first-order  escape  analysis  of  a  non-strict  functional  language  for 
stack  allocation  of  self-modifying  thunks. 

There  have  been  a  number  of  papers  describing  analyses  for  optimizing  storage  of  lists 
and  other  structures.  Most  of  these  analyses  have  been  first-order  (i.e.  not  accounting  for 
higher-order  functions.)  Ruggieri  and  Murtagh  ([71],  [72])  described  a  lifetime  analysis  for 
a  language  with  side-effects  and  complex  data  structures,  but,  again,  it  is  first-order. 

Inoue,  Seki,  and  Yagi  [49]  described  an  analysis  for  functipnal  languages  to  detect, 
and  reclaim  run-time  garbage  cells  based  on  formal  language  theory  and  grammars.  They 
focused  only  on  the  explicit  reclamation  of  cons  cells.  It  is  unclear  if  this  approach  could  be 
extended  for  higher-order  languages.  Besides  being  higher-order,  the  escape  analysis  that 
we  describe  in  this  thesis  is  a  more  general  lifetime  analysis  that  can  be  applied  to  objects 
other  than  lists. 
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Jones  and  LeMetayer  [51]  described  an  algorithm,  based  on  forward  cind  backward  anal- 
yses, for  detecting  sharing  of  objects  in  first-order  functional  languages,  and  describe  a 
method  for  reusing  of  cells  based  on  the  sharing  analysis.  We  use  only  forward  analysis 
providing,  perhaps,  a  simpler  conceptual  framework. 

Chase,  Wegman,  and  Zadeck  [22]  described  a  fijst-order  analysis  for  LISP  that  constructs 
graphs  representing  possible  list  structures  and  analyzes  the  graphs  for  possible  storage 
optimizations.  Our  analysis,  in  contrast,  benefits  from  a  type  system  that  restricts  the 
ways  that  lists  can  be  created  and  that  restricts  the  kinds  of  sharing  that  can  occur  within 
a  list  (for  example,  one  carmot  write  cons(x,x).) 

Deutsch  [28]  presented  a  lifetime  and  sharing  analysis  for  higher-order  languages.  The 
analysis  consisted  of  defining  a  low-level  operational  model  for  a  higher-order  functional 
language,  translating  a  program  into  a  sequence  of  operations  in  this  model,  and  then 
performing  an  analysis  to  determine  the  lifetimes  of  dynamically  created  objects.  The 
approach  is  one  of  collecting  interpretation,  in  that  it  analyzes  a  whole  program  to  infer 
properties  of  program  points.  Our  approach  is  to  define  a  high-level  non-standard  semantics 
that  in  many  ways  is  similar  to  the  standard  semantics  and  captures  the  precise  escape 
behavior  caused  by  the  constructs  in  a  functional  language.  We  then  define  an  abstraction 
of  these  semantics  which  provides  less  precise  information  but  which  allows  the  analysis  to 
be  performed  at  compile  time.  The  advantage  of  our  analysis  lies  in  its  conceptual  simplicity 
and  less  computational  cost  (compared  to  a  collecting  interpretation). 

Deutsch  and  Bobrow  [29]  proposed  a  method  for  reducing  the  overhead  of  updating 
reference  counts  in  which  reference  counting  activities  are  deferred  by  being  stored  into  a 
file  CciUed  a  transaction  file  instead  of  being  immediately  performed.  Reference  counts  are 
then  adjusted  at  suitable  intervals.  Barth  [9]  showed  that  this  particular  reference  count- 
ing scheme  could  benefit  from  compile  time  optimization  by  generating  fewer  transactions 
(reference  counting  activities)  based  on  compile  time  analysis  of  first- order  programs. 

Using  the  idea  of  weighted  references,  i.e.  each  reference  carries  a  weight  such  that 
the  sum  of  the  weights  of  all  references  to  an  object  is  equal  to  the  reference  count  of  the 
object,  there  have  been  a  variety  of  works  [10,82],  in  which,  when  a  new  reference  is  created 
to  an  object,  no  access  to  the  object  is  needed.  Goldberg  [32]  presented  a  generation- 
based  approach  for  distributed  systems  that  also  avoids  reference  count  operations  when 
a  reference  is  created,  and  also  described  the  applicabihty  of  escape  information  among 
references  to  reference  counting  schemes,  but  did  not  present  the  analysis. 

In  the  garbage  collection  area,  using  the  hfetime  of  objects(noi  statically  inferred), 
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Lieberman  and  Hewitt  [58]  suggested  a  copying  garbage  collection  in  which  storage  is  di- 
vided into  regions  according  to  ages.  Hudak  [39]  presented  a  semantic  model  for  describing 
the  number  of  active  pointers  to  objects  for  an  applicative-order  interpreter  of  a  first-order 
function  language,  and  a  variety  of  its  abstractions  based  on  abstract  and  collecting  inter- 
pretations. 

Strictness,  Evaluation  Order,  and  Evaluation  Status  Information 

Information  about  which  arguments  of  a  function  wiU  definitely  be  demanded,  called  strict- 
ness information,  is  used  to  optimize  lazy  evaluation  by  converting  lazy  evaluation  into 
applicative-order  evaluation  and  thus  reducing  the  overhead  of  lazy  evcduation.  Informa- 
tion about  the  order  of  evaluation  of  the  arguments  to  a  function  can  be  useful  for  a  number 
of  optimizations,  including  copy  elimination  [11,30,35]  and  process  scheduling  in  a  parallel 
system  [13].  Information  on  the  status  of  evaluation  of  curguments  when  they  aie  demanded 
is  useful  for  eliminating  unnecessary  checking  [14]. 

There  have  been  many  papers  pubhshed  in  the  field  of  strictness  zinalysis  for  lamguages 
with  higher-order  functions,  polymorphism,  and  non-flat  domains  (  [18],  [45],  [36],  [37],  [43], 
[1],  [80],  [81]),  but  these  do  not  provide  information  about  the  order  or  status  of  evaluation 
of  arguments.  Issues  of  order  of  evaluation  are  addressed  in  [41],  and  a  variety  of  models 
for  obtaining  order  of  evaluation  information  in  a  first-order  non-strict  functional  language 
without  non-flat  domains  are  described  in  [12].  However,  those  models  are  somewhat  com- 
plex and  the  extension  to  higher-order  languages  is  not  clear. 

Bloss  [13]  proposed  a  path  analysis  which  provides  a  range  of  static  information  in- 
cluding strictness,  evaluation-order,  and  evaluation-status  information  in  a  first-order  lazy 
functional  language.  The  analysis  consists  of  determining  the  set  of  all  possible  evaluation 
sequences  called  paths  and  extracting  interesting  information  from  the  set.  Since  the  size 
of  the  abstract  semantic  domain  is  very  large,  the  time  complexity  of  the  analysis  for  first- 
order  languages  is  significantly  higher  than  that  of  strictness  analysis.  Path  analysis  can 
cdso  be  extended  to  higher-order  languages  [11].  However,  the  complexity  becomes  even 
worse  in  the  case  of  higher-order  languages,  cmd  it  is  not  clear  how  to  extract  much  useful 
information  from  higher  order  path  analysis.  In  [35]  a  method,  similar  to  the  path  model, 
for  extracting  some  information  about  order  of  evaluation  in  a  higher-order  strict  functional 
language  was  presented. 

Draghicescu  and  Purushothaman  [30]  presented  a  compositional  analysis  for  obtaining 
at  compile-time  some  information  about  the  order  of  evaluation  of  variables  in  a  first-order 
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non-strict  functional  language  with  both  lazy  evaluation  and  other  evaluation  strategies 
using  strictness  information.  This  approach  is  based  on  strictness  information  and  achieves 
a  lower  complexity  than  path  analysis  by  analyzing  relations  between  parameters  instead 
of  computing  aD  possible  paths  of  parameters.  Our  work  deals  with  higher-order  fujictional 
languages  and  uses  a  smaller  abstract  domain  and  thus  shows  much  lower  complexity. 

Polymorphic  Invariance 

Abramsky  [1]  extended  the  strictness  analysis  for  monomorphic  languages  to  polymorphic 
languages  based  on  the  notion  of  polymorphic  invariance.  This  implies  that  the  strictness 
property  derived  from  one  monomorphic  instance  of  a  polymorphic  function  applies  to  all 
possible  monomorphic  instances.  Hughes  [47]  proposed  a  method  for  extending  abstract  in- 
terpretation to  first-order  polymorphic  functions  by  calcidating  approximations  to  abstract 
functions  of  all  instances  from  the  abstract  function  of  the  simplest  monomorphic  instance. 
Abramsky  and  Jensen  [3]  showed  a  proof  of  the  polymorphic  invariance  of  strictness  analysis 
based  on  the  categorical  notions  of  relators  and  transformations. 

9.2      Summary 

One  of  the  major  overheads  that  incur  in  implementing  functional  languages  is  the  storage 
management  overhead  due  to  dynamic  allocation  and  automatic  reclamation  of  indefinite- 
extent  storage.  The  goal  of  this  thesis  was  to  compute  information  about  the  lifetime 
of  dynamically-allocated  objects  in  higher-order,  polymorphic,  (either  strict  or  non-strict) 
functional  languages  with  non-flat  domains,  through  semantics-based  compile-time  analyses 
of  high-level  source  programs,  and  to  use  such  statically  inferred  information  for  reducing 
the  storage  management  overhead  in  functional  language  implementations. 

In  a  higher-order  functional  language,  exact  information  about  the  lifetime  of  objects, 
such  as  arguments  and  local  objects  defined  within  a  function,  with  respect  to  the  lifetime 
of  the  activation  of  the  function  call  is  generally  unknown  at  compile-time.  Thus,  when 
storage  is  needed  to  be  allocated  for  such  object,  it  is  usually  allocated  from  a  heap  and  has 
to  be  reclaimed  using  some  kind  of  automatic  reclamation  methods.  Lifetime  information, 
if  inferred  at  compile-time,  can  be  useful  for  efficient  management  of  storage  allocated  for 
those  objects  at  run-time.  In  Chapter  2,  we  have  presented  a  method  for  computing  safe 
information  about  the  relative  lifetime  of  arguments  and  local  objects  defined  within  a 
function  with  respect  to  the  lifetime  of  an  activation  of  the  function  for  a  monomorphic. 
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strict,  higher-order  functional  language.  This  method  is  based  on  a  compile-time  semantic 
analysis  ccilled  escape  analysis  which  provides  information  about  the  lifetimes  of  objects 
A  method  for  improving  the  precision  of  escape  information  is  also  presented  using  the 
position  information  of  objects  in  a  list  structure. 

For  structured  objects  such  as  lists  and  trees,  the  escape  information  that  is  obtainable 
through  the  escape  analysis  is  rather  coarse  because  it  does  not  specify  how  much  extent  of 
the  object  escapes  even  when  ordy  some  part  of  structured  object  escapes.  In  Chapter  3,  we 
have  developed  a  method  for  computing  more  refined  escape  information  for  a  monomorphic, 
strict,  higher-order  fimctional  Icinguage.  This  method  is  based  on  a  compile-time  semantic 
analysis  called  refined  escape  analysis  which  is  an  extension  of  the  escape  analysis  and 
indicates  how  much  of  an  object  outlives  the  activation  of  the  fimction  call. 

In  a  higher-order  functional  language,  exact  information  about  the  lifetime  of  a  dynam- 
ically created  reference  to  a  heap-allocated  object  is  genercdly  unknown  at  compile-time. 
Such  information,  if  inferred  at  compile-time,  can  be  useful  for  improving  the  reference 
covmting  scheme  for  both  uniprocessor  £ind  multiprocessor  environments.  In  Chapter  4, 
we  have  described  a  method  for  computing  at  compile-time  safe  information  about  the 
relative  lifetime  of  dynamically  created  references  to  objects.  This  method  is  based  on  a 
compile-time  semantic  analysis  called  reference  escape  analysis. 

In  lazy  evaluation,  arguments  to  a  function  are  not  evaluated  unless  and  until  their  values 
are  demanded,  and  are  evaluated  only  once  upon  the  first  demand.  Their  values  are  then 
saved  to  be  used  for  subsequent  demands,  thus  avoiding  reevaluation.  Exact  information 
about  the  strictness  of  arguments,  the  order  of  evaluation  among  the  arguments,  and  the 
evaluation  status  of  argvunents  when  demanded  is  generally  unknown  at  compile-time.  If 
inferred  at  compile-time,  such  information  can  be  useful  for  a  number  of  optimizations  for 
lazy  evaluation.  In  Chapter  5,  we  have  presented  a  method  for  statically  inferring  a  range 
of  information  including  strictness,  evaluation-order,  and  evaluation-status  information  in 
a  monomorphic,  higher-order,  non-strict  (with  lazy  evaluation)  functional  language.  This 
method  is  based  on  a  compile-time  analysis  called  order-of-demand  analysis  which  provides 
safe  information  about  the  order  in  which  the  values  of  bound  variables  are  demanded. 

AU  of  the  semantic  analysis  presented  in  the  preceding  chapters  have  dealt  with  a  higher- 
order  fimctional  language  with  monomorphic  type  system  in  which  every  expression  is  rigidly 
typed.  Most  modern  functional  languages  adopt  a  rich  polymorphic  type  system  which  is 
more  flexible.  In  Chapter  6,  we  have  described  a  method,  based  on  the  notion  of  polymorphic 
invariance,  for  applying  the  escape  analysis,  the  reference  escape  analysis,  and  the  order- 
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of-demand  cinalysis  for  a  monoinorphic  language  to  a  polymorphic  language. 

In  Chapter  7,  we  have  extended  the  escape  analysis  and  the  reference  escape  analysis  for 
a  strict  language  to  a  non-strict  (either  with  normal-order  evaluation  or  with  lazy  evaluation) 
language.  Based  on  a  source-to-source  transformation  of  non-strict  programs,  we  have 
described  a  method  to  extend  the  escape  analysis  and  the  reference  escape  analysis  for  a 
strict  language  to  a  non-strict  language  with  normal- order  evaluation  using  the  analysis 
techniques  for  a  strict  language.  The  lazy  evaluation  model  is  identical  to  normal-order 
evaluation  model  in  the  standard  semantics,  but  not  in  its  operational  semantics.  We 
then  presented  the  escape  analysis  and  the  reference  escape  analysis  of  non-strict  functional 
languages  with  lazy  evaluation  based  on  the  evaluation  status  information  statically  inferred 
by  the  order-of-demand  analysis  presented  in  Chapter  5. 

Finally,  in  Chapter  8,  based  on  the  statically  inferred  escape  information,  we  proposed  a 
variety  of  optimization  techniques  to  reduce  the  storage  management  overheads  in  functional 
language  implementations.  These  include  stack  allocation,  explicit  reclamation,  in-place 
reuse  of  garbage  cells,  reference  counting  elimination,  block  allocation/reclamation,  and 
improving  generational  garbage  collection. 

9.3      Future  Work 

We  would  like  to  observe  how  a  combination  of  these  analyses  and  optimizations  described 
in  this  thesis  work  when  they  are  implemented  in  real  compilers.  Future  work  includes 
extensions  of  escape  analyses  to  user-defined  types  (e.g.  trees,  etc.)  and  investigations  of 
more  efficient  algorithms  for  finding  fixpoints  or  of  using  a  type  system.  Effective  extension 
of  the  order-of-demand  analysis  to  functional  languages  with  hsts  and  investigation  of  its 
applications  for  optimizations  in  lazy  evaluation  would  be  useful. 

For  practical  purpose,  it  will  be  worth  investigating  a  method  for  determining  at  compile- 
time  whether  the  stack  allocation  optimization  is  safe  in  the  sense  that  such  optimization 
does  not  convert  a  program  that  runs  robustly  into  one  that  does  not. 

It  might  also  be  fruitfvd  to  develop  other  semantic  analyses  for  higher-order  functional 
languages  based  on  the  framework  which  is  used  in  the  semantic  analyses  presented  in  this 
thesis. 
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